-- Logs begin at Tue 2022-05-03 21:40:21 UTC, end at Tue 2022-05-03 23:10:44 UTC. -- May 03 22:27:06.991787 dv-cinder-784815-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 03 22:27:07.003385 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 3 22:27:07 2022] *** May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: nodename: dv-cinder-784815-12-iscsi May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: machine: x86_64 May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: clock source: unix May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: pcre jit disabled May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: detected number of CPU cores: 4 May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: current working directory: / May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: detected binary path: /usr/bin/uwsgi-core May 03 22:27:07.004398 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: your processes number limit is 47680 May 03 22:27:07.005010 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: your memory page size is 4096 bytes May 03 22:27:07.005010 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: detected max file descriptor number: 2048 May 03 22:27:07.005010 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: lock engine: pthread robust mutexes May 03 22:27:07.005010 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: thunder lock: enabled May 03 22:27:07.005010 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 03 22:27:07.005010 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 03 22:27:07.050015 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: Python main interpreter initialized at 0x560282cda9c0 May 03 22:27:07.050015 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: python threads support enabled May 03 22:27:07.050015 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: your server socket listen backlog is limited to 100 connections May 03 22:27:07.050015 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: your mercy for graceful operations on workers is 90 seconds May 03 22:27:07.050366 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: mapped 403077 bytes (393 KB) for 2 cores May 03 22:27:07.050440 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: *** Operational MODE: preforking *** May 03 22:27:07.050689 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: *** uWSGI is running in multiple interpreter mode *** May 03 22:27:07.050689 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: spawned uWSGI master process (pid: 80263) May 03 22:27:07.055847 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: spawned uWSGI worker 1 (pid: 80275, cores: 1) May 03 22:27:07.055847 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: spawned uWSGI worker 2 (pid: 80276, cores: 1) May 03 22:27:07.055847 dv-cinder-784815-12-iscsi devstack@keystone.service[80263]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 03 22:27:07.050916 dv-cinder-784815-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 03 22:27:12.827887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 22:27:12.827887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: from cryptography.utils import int_from_bytes May 03 22:27:12.828706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 22:27:12.828706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: from cryptography.utils import int_from_bytes May 03 22:27:12.829680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 22:27:12.829680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: from cryptography.utils import int_from_bytes May 03 22:27:12.829795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 03 22:27:12.829795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: from cryptography.utils import int_from_bytes May 03 22:27:12.879195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 22:27:12.879360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 03 22:27:12.879453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 22:27:12.879543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 03 22:27:12.879715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] command line args: [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 22:27:12.879803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] command line args: [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 03 22:27:12.879886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 22:27:12.879959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 03 22:27:12.880035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ================================================================================ {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 22:27:12.880112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ================================================================================ {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 03 22:27:12.880240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] admin_token = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.880329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] admin_token = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.880497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] config_dir = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.880591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] config_dir = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.880670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.880776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.880908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] config_source = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] config_source = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] debug = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] debug = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881609 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.881977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_config_append = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_config_append = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.882976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_dir = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_dir = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_file = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_file = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.883956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.884923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885265 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.885918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.886065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.886148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.886317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.886492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.886580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.886718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.887063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.887273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] publish_errors = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.887721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.887811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.887909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] publish_errors = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891713 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] standard_threads = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] standard_threads = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.891975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] use_journal = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] use_json = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] use_stderr = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] use_journal = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] use_syslog = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] use_json = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] use_stderr = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] use_syslog = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.892884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 03 22:27:12.892948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.893974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.894962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.895953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.896906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.897942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.898883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.899976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.900918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.901954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.902882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.903893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.904890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.905819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906265 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.906992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.907939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.908868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.909883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.910952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.911947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.912991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.913929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.914962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.external = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.external = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.915943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.password = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] auth.token = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.password = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] auth.token = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.916966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.917899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.918917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.919894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.920966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.921912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.922026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.922147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.922267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.922382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.922505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.922622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.923958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.924898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925136 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.925966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.926894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.927881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.928926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.929989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.930916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.932888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.933901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.934961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.935949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.936993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.937926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.938040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.938155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.938272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.938395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.939120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.939236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.939345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.939445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.939541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.942574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.942698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.942778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.942850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.942929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.943934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.944964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.945981 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.946936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.947983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] role.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] role.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.948948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] role.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] role.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.949971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.950874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.951936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.952901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.953955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.954923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.955911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.956955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.957996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.958939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.959890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.connection = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.connection = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.960917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.961995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.962930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.963997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.964944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.965058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 03 22:27:12.965173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 22:27:12.965289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 03 22:27:12.996067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:12.996295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:12.996521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.003935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.004163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.004385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.005874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.013265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.034356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.034590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.039765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.044271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.092519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.092630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.151398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.151645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.151759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.151911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.222464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.222696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.222848 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.222957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.223989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.252951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.253113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.253196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.253325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.253412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.253531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.253614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.265386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.265688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.280621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.280853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.281958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.282131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.282354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 03 22:27:13.299139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.299348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 22:27:13.299715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.299797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.299921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 22:27:13.300005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 22:27:13.300194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.300321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.300458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.300549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 03 22:27:13.300715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.300796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.300972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.301061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.301290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.301542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.312077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.312347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.312613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.312787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.312890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.313061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.313898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.314178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.321588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.322544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.324923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.325200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.325480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.325875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.325956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.326151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.326235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.326411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.326492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.326681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.326800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.326953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.327901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.328129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.328397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.328656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.355366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.356916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.357020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.357261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.358556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.358837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.362661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.362941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.363221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.364412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.364690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.364967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.370716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.370995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.372414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.372693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.375693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.376508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.376792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.377073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.377350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.377620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.377859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.377952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.378140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.378234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.378414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.378691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.378959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.379225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.379490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.379775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.397704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.397977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.399303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.399575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.402535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.404130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.406189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.406480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.410210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.410210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.411529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.413031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.415147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.416638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.418930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.419228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.419513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.419826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.420101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.420377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.420458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.420674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.420948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.421223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.421491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.421763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.439980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.440353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.440620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.440884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.441636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.442008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.442271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.442531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.448842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.450479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.450572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.450816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.452217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.452491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.453913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.454793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.455089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.455377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.455685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.456116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.456394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.456677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.456964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.457241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.469267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.469547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.469859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.470142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.470426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.470703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.470806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.470990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.471071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.471349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.471647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.471929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.472202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.472536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.489326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.490861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.492654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.494167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.496049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.497536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.497660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.499148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.499304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.499582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.499891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.501349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.501635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.501923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.507921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.509434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.509566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.511058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.513118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.513408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.513701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.513977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.514588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.514873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.515164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.515438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.524645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.524941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.525223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.525305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.525576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.525855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.533387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.533666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.533958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.534148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 03 22:27:13.534231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.534424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.534588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.534743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.534823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.534983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.535928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.536987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.537166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.537426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.537695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 03 22:27:13.576463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560282cda9c0 pid: 80276 (default app) May 03 22:27:13.576982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560282cda9c0 pid: 80275 (default app) May 03 22:27:13.580381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595a2b-6252-464a-aabb-9947bb283977 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:13.580679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595a2b-6252-464a-aabb-9947bb283977 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:13.580963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae595a2b-6252-464a-aabb-9947bb283977 None None] PATH_INFO: `/v3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:13.585131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue May 3 22:27:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:23.013224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff6c8-45f0-47bc-aa35-2626538b783b None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:23.013742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff6c8-45f0-47bc-aa35-2626538b783b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:23.013828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eff6c8-45f0-47bc-aa35-2626538b783b None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:23.018673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:23.024176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:23.024575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:23.024750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:23.054525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG oslo_db.sqlalchemy.engines [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 22:27:23.237091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG passlib.handlers.bcrypt [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80276) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 22:27:23.237431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG passlib.handlers.bcrypt [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80276) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 22:27:23.292555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:23.294145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:23.419598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 03 22:27:23.569466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff6c8-45f0-47bc-aa35-2626538b783b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:23.603509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG oslo_db.sqlalchemy.engines [None req-53eff6c8-45f0-47bc-aa35-2626538b783b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 03 22:27:23.731619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eff6c8-45f0-47bc-aa35-2626538b783b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:23.735910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:23.736570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:23.736854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:23.737127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:23.745089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:23.796682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 22:27:23.797028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6ec46-0a57-41ba-afc1-24fc2bca06df admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:23.806283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue May 3 22:27:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:27:23.812192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:23.826605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56fdb-7dd9-4556-89d2-c41dbc1b83e8 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:23.831443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:23.832581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:23.832867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:23.833146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] PATH_INFO: `/v3/projects/479aaf8f5b564abd915b2557f4bef485` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:23.834634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=479aaf8f5b564abd915b2557f4bef485)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:23.884356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 03 22:27:23.884694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba262e3-fbae-4ea4-901a-51338b0065a5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:23.889386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue May 3 22:27:23 2022] GET /identity/v3/projects/479aaf8f5b564abd915b2557f4bef485 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:26.081615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8a7b6-932a-47f5-b827-148a3e3e40de None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:26.082106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8a7b6-932a-47f5-b827-148a3e3e40de None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:26.082185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8a7b6-932a-47f5-b827-148a3e3e40de None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:26.086230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:26.091567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:26.091984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:26.092158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:26.111897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:26.113419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:26.121294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 03 22:27:26.145238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8a7b6-932a-47f5-b827-148a3e3e40de None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:26.156898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8a7b6-932a-47f5-b827-148a3e3e40de None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:26.161040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84b4c-25ed-40a5-85b3-91b191b90d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:26.161656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84b4c-25ed-40a5-85b3-91b191b90d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:26.161937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84b4c-25ed-40a5-85b3-91b191b90d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:26.162211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84b4c-25ed-40a5-85b3-91b191b90d54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:26.169633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84b4c-25ed-40a5-85b3-91b191b90d54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:26.171391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84b4c-25ed-40a5-85b3-91b191b90d54 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:26.179875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue May 3 22:27:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:27:26.184883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:26.194188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650b77d-9c8e-4654-b39b-2991dcbbb6bc None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:26.198579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a35cc-4a7a-46a5-b2c9-fe39d772ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:26.199418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a35cc-4a7a-46a5-b2c9-fe39d772ad13 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:26.199743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a35cc-4a7a-46a5-b2c9-fe39d772ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:26.200024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a35cc-4a7a-46a5-b2c9-fe39d772ad13 admin admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:26.201402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a35cc-4a7a-46a5-b2c9-fe39d772ad13 admin admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:26.203207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a35cc-4a7a-46a5-b2c9-fe39d772ad13 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:26.204848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue May 3 22:27:26 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:28.502726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7285-7d40-46df-8a57-c9486939de80 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:28.503277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ef8e8-b932-4f0a-8313-d125040203cd None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:28.503642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7285-7d40-46df-8a57-c9486939de80 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:28.503726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ef8e8-b932-4f0a-8313-d125040203cd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:28.503792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd7285-7d40-46df-8a57-c9486939de80 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:28.503856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ef8e8-b932-4f0a-8313-d125040203cd None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:28.504801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:28.504907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:28.509456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ad40-0664-4638-8006-61a117b24656 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:28.509582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:28.509738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ad40-0664-4638-8006-61a117b24656 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:28.509843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:28.510010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ad40-0664-4638-8006-61a117b24656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:28.510093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:28.553200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG passlib.handlers.bcrypt [None req-b431ad40-0664-4638-8006-61a117b24656 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80275) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 03 22:27:28.553626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG passlib.handlers.bcrypt [None req-b431ad40-0664-4638-8006-61a117b24656 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80275) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 03 22:27:28.601285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b431ad40-0664-4638-8006-61a117b24656 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:28.602923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b431ad40-0664-4638-8006-61a117b24656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:28.635262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:28.636500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:28.712053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:28.714205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:28.734442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:28.735953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431ad40-0664-4638-8006-61a117b24656 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:28.834402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ea77b-2e3f-4c5a-bbf7-68a0ee65b8a6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:28.840694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431ad40-0664-4638-8006-61a117b24656 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:28.869754 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:28.870547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:28.870828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:28.871102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:28.881957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:28.882971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:28.883075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:28.883280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:28.883559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:28.894318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:28.895183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:28.895987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 8/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:28.901307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:28.949022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:28.950549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:28.997542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71f6e-44f4-4457-9cc5-d6c6c502faa1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:29.039475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:29.040454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:29.040742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:29.041023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:29.042961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:29.043278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:29.044717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:29.045734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 7/15] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:27:29.052022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:29.061438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 9/16] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:29.067539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:29.168781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c159-aa41-4155-840e-32dcf08b201e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:29.202516 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:29.203378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:29.203718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:29.203998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:29.205198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:29.206647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:29.208268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 10/17] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:29 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:29.213655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:29.253661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ae832-bcde-4140-b80a-a1c9355597fa None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:29.285741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:29.286540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:29.286827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:29.287104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:29.305702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:29.306729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac719c7-1a05-4cc8-bd0c-fb1e730ea529 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:29.307158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:27:29.326709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:29.327576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:29.328700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:27:29.328700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:27:29.328700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:27:29.328700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:29.328700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 8/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:27:29.333681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:29.338642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:29.339440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:29.339773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:29.340055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:29.341246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:29.342702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:29.349253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 11/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:29.350338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:29.428593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0c400-1330-455d-bb83-16e1f4dfa05d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:29.443272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0f73c-f4a4-4240-9e0e-efbc8cacf365 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:29.460184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:29.460836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:29.461119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:29.461395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:29.462121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:29.462429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:29.463834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4122c-1b67-40a1-b429-52401d674ded None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:29.475619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:29.476266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:29.476551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:29.476831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:29.477658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.domain.id=default, user.id=a29ada27094d4702b47eeff209b1d340) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:29.477967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:29.479392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a5e8b-3461-4679-9d4a-aa3595b78870 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:29.480424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 9/20] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:29.486908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 12/21] 10.222.0.23 () {56 vars in 1322 bytes} [Tue May 3 22:27:29 2022] GET /identity/v3/role_assignments?user.id=a29ada27094d4702b47eeff209b1d340&scope.domain.id=default&role.id=4c81f00224c04152b175b99a19a7b21c => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:31.966619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014acb-627e-471f-a563-786303df133d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:31.967728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014acb-627e-471f-a563-786303df133d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:31.968234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4014acb-627e-471f-a563-786303df133d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:31.970839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 10/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:31.981572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ba07a-1a74-45c8-b12f-2dccbe3dbc3f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:31.982549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ba07a-1a74-45c8-b12f-2dccbe3dbc3f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:31.983032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ba07a-1a74-45c8-b12f-2dccbe3dbc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.000255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-df4ba07a-1a74-45c8-b12f-2dccbe3dbc3f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:32.002288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-df4ba07a-1a74-45c8-b12f-2dccbe3dbc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:32.085953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 13/23] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:32.124955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4014acb-627e-471f-a563-786303df133d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:32.212827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5409-6a61-4c42-bac3-7a67e1f9a99f None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.213466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5409-6a61-4c42-bac3-7a67e1f9a99f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.213969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5409-6a61-4c42-bac3-7a67e1f9a99f None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.215861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 14/24] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:32.221181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.221712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.222189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.239114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:32.240642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:32.257424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4014acb-627e-471f-a563-786303df133d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:32.331729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 15/25] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:32.341180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:32.341979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.342263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.342533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.351995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:32.365319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:32.379057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:32.379996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:32.380765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 11/26] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:32.386516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:32.455509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7292ce-35f7-40fc-965d-9155366f49e6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:32.490425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974983dc-5f5f-4ab0-aa49-202823ba0699 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:32.491239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:32.492175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.492663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.493149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.494084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:32.495768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:32.524516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:32.525183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.525462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.525729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.526696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:32.527155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:32.528813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38988c1-bee5-4bd8-a00b-4ca2072c3f80 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:32.542001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 12/27] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:32.543577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62343-db85-4e76-9515-f4cdccf7abf7 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.551169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62343-db85-4e76-9515-f4cdccf7abf7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.551169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d62343-db85-4e76-9515-f4cdccf7abf7 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.551169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 13/28] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:32.551933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d62343-db85-4e76-9515-f4cdccf7abf7 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:32.662638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d62343-db85-4e76-9515-f4cdccf7abf7 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:32.707773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b67f-a1ec-4466-9f84-5feb4ae3dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:32.708989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b67f-a1ec-4466-9f84-5feb4ae3dd5c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.709461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b67f-a1ec-4466-9f84-5feb4ae3dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.709894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b67f-a1ec-4466-9f84-5feb4ae3dd5c None admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.711642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b67f-a1ec-4466-9f84-5feb4ae3dd5c None admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:32.713390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b67f-a1ec-4466-9f84-5feb4ae3dd5c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:32.715727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:32 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:32.717088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.722017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.722515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.743506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:32.743506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:32.810529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 15/30] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:32.811765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:32.836561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 16/31] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 22:27:32 2022] POST /identity/v3/roles => generated 219 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:27:32.859964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:32.917062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414f240-1a81-4213-a332-90cbd128f376 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:32.952418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:32.953491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:32.953956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:32.954376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:32.955793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:32.957507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:32.959381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 16/32] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:32.974531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:33.114855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa9c06-b91f-49c1-bd98-3c75169093ef None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:33.161732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c853b7-011d-427e-b9f6-03605371eb0b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:33.188485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:33.189585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.190017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.190430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.209585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:33.213749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:33.238792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:33.239988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.240407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.240843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] PATH_INFO: `/v3/domains/default/users/a29ada27094d4702b47eeff209b1d340/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.245787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a29ada27094d4702b47eeff209b1d340, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-b98bc335-b024-46e3-8964-172f05942918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:27:33.245976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:33.246895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:33.247807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:27:33.247807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:27:33.247807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:27:33.247807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:33.248018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:33.249479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:33.250998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c1ad7-adab-4a22-b976-de5d50d07787 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.251453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c1ad7-adab-4a22-b976-de5d50d07787 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.252116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c1ad7-adab-4a22-b976-de5d50d07787 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.253821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 18/34] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:33.260138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c1ad7-adab-4a22-b976-de5d50d07787 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:33.380335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c1ad7-adab-4a22-b976-de5d50d07787 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:33.419047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:33.419829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.420159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.420495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.421317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:33.421635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:33.423247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd0738-aee3-448e-9857-f96232ade815 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:33.448623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 19/35] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:33.450121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9df9-dad7-499d-8f34-1ca5c56bf773 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.450474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9df9-dad7-499d-8f34-1ca5c56bf773 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.450760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f9df9-dad7-499d-8f34-1ca5c56bf773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.470431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e09f9df9-dad7-499d-8f34-1ca5c56bf773 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:33.471086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 17/36] 10.222.0.23 () {58 vars in 1361 bytes} [Tue May 3 22:27:32 2022] PUT /identity/v3/domains/default/users/a29ada27094d4702b47eeff209b1d340/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:27:33.472356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:33.476854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e09f9df9-dad7-499d-8f34-1ca5c56bf773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:33.572830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 20/37] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:33.614316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869fbcf-48a6-4e6c-bd3c-9a96abb16de5 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.614779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869fbcf-48a6-4e6c-bd3c-9a96abb16de5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.614969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869fbcf-48a6-4e6c-bd3c-9a96abb16de5 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.616720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:33.617658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869fbcf-48a6-4e6c-bd3c-9a96abb16de5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:33.672861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed6b24-5e32-42f3-a11c-1f8a8d0477f7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:33.709319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733d7e2-fa07-4400-aac9-fdc2759c38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:33.710026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d7e2-fa07-4400-aac9-fdc2759c38de None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.710310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d7e2-fa07-4400-aac9-fdc2759c38de None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.710590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d7e2-fa07-4400-aac9-fdc2759c38de None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.711331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733d7e2-fa07-4400-aac9-fdc2759c38de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:33.713043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733d7e2-fa07-4400-aac9-fdc2759c38de None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:33.737615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869fbcf-48a6-4e6c-bd3c-9a96abb16de5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:33.772144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:33.772999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.773286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.773562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.774305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:33.775732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:33.835983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 18/39] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:27:33 2022] POST /identity/v3/projects => generated 301 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:33.837521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee01b8-3d56-4280-9423-e93041c86f2d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:33.837818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee01b8-3d56-4280-9423-e93041c86f2d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:33.838098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee01b8-3d56-4280-9423-e93041c86f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:33.862031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3aee01b8-3d56-4280-9423-e93041c86f2d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:33.863849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3aee01b8-3d56-4280-9423-e93041c86f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:33.874486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 22/40] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 22:27:33 2022] POST /identity/v3/roles => generated 225 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:33.963322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:34.022274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:34.105880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f34e5-2219-4326-a472-0b58b7d116e0 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:34.106387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f34e5-2219-4326-a472-0b58b7d116e0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:34.106461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f34e5-2219-4326-a472-0b58b7d116e0 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:34.107909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 20/42] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:34.113454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:34.113745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:34.114031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:34.133395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:34.135123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:34.154381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704530d-6f82-4f23-8b8f-9f2e5df3b0b0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:34.200090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:34.200889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:34.201177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:34.201515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:34.203510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:34.205637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:34.207148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 23/43] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:34.212545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:34.224799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:27:34.249714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:34.338135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686362-5e96-4693-869f-e9c39fa7e914 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:34.363443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e171e-9c17-4e26-aed7-2915b0c733fe None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:34.369625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449912b1-c50d-487c-a259-57cee6412d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:34.370290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449912b1-c50d-487c-a259-57cee6412d43 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:34.370573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449912b1-c50d-487c-a259-57cee6412d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:34.370851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449912b1-c50d-487c-a259-57cee6412d43 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:34.371595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449912b1-c50d-487c-a259-57cee6412d43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:34.373064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449912b1-c50d-487c-a259-57cee6412d43 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:34.397324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34acdf-1451-4c4b-8150-420d14474785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:34.399468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34acdf-1451-4c4b-8150-420d14474785 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:34.399468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34acdf-1451-4c4b-8150-420d14474785 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:34.399468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34acdf-1451-4c4b-8150-420d14474785 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:34.399468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34acdf-1451-4c4b-8150-420d14474785 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:34.400666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34acdf-1451-4c4b-8150-420d14474785 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:34.463198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 24/45] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:27:34 2022] POST /identity/v3/projects => generated 312 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:27:34.494309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 22:27:34 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:27:35.879959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9c45-ee5d-4802-9636-71b446a6ed9b None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:35.880474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9c45-ee5d-4802-9636-71b446a6ed9b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:35.880587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9c45-ee5d-4802-9636-71b446a6ed9b None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:35.881874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:35.886882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:35.887286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:35.887480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:35.904422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:35.905605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:35.967945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:35.992123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9c45-ee5d-4802-9636-71b446a6ed9b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:36.088358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9c45-ee5d-4802-9636-71b446a6ed9b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:36.121386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:36.122171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.122454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.122733 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.133153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:36.140850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:36.141676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:36.142428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:36.147917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:36.240039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488f7ba-b0ea-4651-b5d2-adf3e388752b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:36.271645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:36.272303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.272582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.272854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.273598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:36.273903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:36.275276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:36.283132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 24/50] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:36.288605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:36.383895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9afec-0dd6-4060-bccc-9f60764e7c69 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:36.415027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:36.415920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.416207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.416486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.417671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:36.419122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:36.420792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 27/51] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:36 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:36.426776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:36.521087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5224e02-b5d6-4302-b261-f62194540b5d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:36.555381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd129cf-2bfe-4ba6-b30c-e26a95852c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:36.556213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd129cf-2bfe-4ba6-b30c-e26a95852c52 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.556493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd129cf-2bfe-4ba6-b30c-e26a95852c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.556767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd129cf-2bfe-4ba6-b30c-e26a95852c52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.557953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd129cf-2bfe-4ba6-b30c-e26a95852c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:36.559406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd129cf-2bfe-4ba6-b30c-e26a95852c52 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:36.561058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 25/52] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:36.567322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:36.664144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f9923-f8f8-4722-9ebe-f691fd302193 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:36.695849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:36.696499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.696782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.697056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.697884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.domain.id=default, user.id=a29ada27094d4702b47eeff209b1d340) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:36.698191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:36.699683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf72e6-638c-45d9-9eac-16a5267cfa3c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:36.705920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 28/53] 10.222.0.23 () {56 vars in 1322 bytes} [Tue May 3 22:27:36 2022] GET /identity/v3/role_assignments?user.id=a29ada27094d4702b47eeff209b1d340&scope.domain.id=default&role.id=4c81f00224c04152b175b99a19a7b21c => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:36.711563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039dca-92a1-4194-935d-b807fffbab75 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.711965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039dca-92a1-4194-935d-b807fffbab75 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.712317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e039dca-92a1-4194-935d-b807fffbab75 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.713816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 26/54] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:36.719568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.719894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.720173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.738129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:36.739360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:36.810044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 29/55] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:36.834687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e039dca-92a1-4194-935d-b807fffbab75 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:36.945856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e039dca-92a1-4194-935d-b807fffbab75 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:36.976900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6642d-a5ed-4e78-b6af-5ae972c009bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:36.977685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6642d-a5ed-4e78-b6af-5ae972c009bf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:36.977963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6642d-a5ed-4e78-b6af-5ae972c009bf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:36.978237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6642d-a5ed-4e78-b6af-5ae972c009bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:36.979389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6642d-a5ed-4e78-b6af-5ae972c009bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:36.980868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6642d-a5ed-4e78-b6af-5ae972c009bf None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:36.982465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 27/56] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:36.988602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:37.080284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f96d9-cd91-45b9-b6d9-e71aebb7fca6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:37.111688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2335be-7283-4a5a-a3f7-27c897ebbf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:37.112329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2335be-7283-4a5a-a3f7-27c897ebbf5f None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:37.112608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2335be-7283-4a5a-a3f7-27c897ebbf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:37.112878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2335be-7283-4a5a-a3f7-27c897ebbf5f None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:37.113583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2335be-7283-4a5a-a3f7-27c897ebbf5f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:37.115012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2335be-7283-4a5a-a3f7-27c897ebbf5f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:37.219762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 30/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue May 3 22:27:36 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:39.430625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078860b3-16d9-42c7-99ab-4f300b5e0d90 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:39.431130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078860b3-16d9-42c7-99ab-4f300b5e0d90 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:39.431214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078860b3-16d9-42c7-99ab-4f300b5e0d90 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:39.432598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 28/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:39.437645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:39.438083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:39.438210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:39.454925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:39.456133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:39.518311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 31/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:39.549260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078860b3-16d9-42c7-99ab-4f300b5e0d90 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:39.646298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078860b3-16d9-42c7-99ab-4f300b5e0d90 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:39.677386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae4975-6c00-4e74-b182-83fcc22fcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:39.678167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae4975-6c00-4e74-b182-83fcc22fcb13 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:39.678453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae4975-6c00-4e74-b182-83fcc22fcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:39.678731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae4975-6c00-4e74-b182-83fcc22fcb13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:39.679973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae4975-6c00-4e74-b182-83fcc22fcb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:39.681477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae4975-6c00-4e74-b182-83fcc22fcb13 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:39.683035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 29/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:39.689048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:39.781800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73899756-1693-49b1-81f2-ac92f578b7b3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:39.813569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb569487-3d64-4f62-b64a-49194a71fe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:39.814225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569487-3d64-4f62-b64a-49194a71fe6e None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:39.814512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569487-3d64-4f62-b64a-49194a71fe6e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:39.814793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb569487-3d64-4f62-b64a-49194a71fe6e None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:39.815504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb569487-3d64-4f62-b64a-49194a71fe6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:39.816984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb569487-3d64-4f62-b64a-49194a71fe6e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:39.950187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 32/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:27:39 2022] POST /identity/v3/users => generated 275 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:43.162362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fe442-8096-4fd8-97e9-ed9f7dcc2619 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.163386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fe442-8096-4fd8-97e9-ed9f7dcc2619 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.163927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fe442-8096-4fd8-97e9-ed9f7dcc2619 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.165807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 30/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:43.170578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f15d7-c4f0-48a1-a22b-37ad53453a60 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.171375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f15d7-c4f0-48a1-a22b-37ad53453a60 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.171881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f15d7-c4f0-48a1-a22b-37ad53453a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.196624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9b5f15d7-c4f0-48a1-a22b-37ad53453a60 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:43.198157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9b5f15d7-c4f0-48a1-a22b-37ad53453a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:43.293775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 33/63] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:43.329100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fe442-8096-4fd8-97e9-ed9f7dcc2619 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:43.441739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162b7f-b695-4799-918d-ee69f295519a None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.448768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162b7f-b695-4799-918d-ee69f295519a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.448768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0162b7f-b695-4799-918d-ee69f295519a None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.448768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 34/64] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:43.449912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374d45b-df95-4f69-8905-a0f179bc26a5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.450409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374d45b-df95-4f69-8905-a0f179bc26a5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.450912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374d45b-df95-4f69-8905-a0f179bc26a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.478634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fe442-8096-4fd8-97e9-ed9f7dcc2619 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:43.482520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3374d45b-df95-4f69-8905-a0f179bc26a5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:43.484087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3374d45b-df95-4f69-8905-a0f179bc26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:43.513317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c7064-4f7e-4c43-80c3-62f2b55c6d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:43.514287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c7064-4f7e-4c43-80c3-62f2b55c6d51 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.514579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c7064-4f7e-4c43-80c3-62f2b55c6d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.514860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c7064-4f7e-4c43-80c3-62f2b55c6d51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.526490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c7064-4f7e-4c43-80c3-62f2b55c6d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-3b2c7064-4f7e-4c43-80c3-62f2b55c6d51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:43.535142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:43.536260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:43.537135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:43.539350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 31/65] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:43.540911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbd68-0b71-4f78-8d62-fdeb3f0e6ecd None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.541377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbd68-0b71-4f78-8d62-fdeb3f0e6ecd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.541832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcbd68-0b71-4f78-8d62-fdeb3f0e6ecd None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.544209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 32/66] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:43.549419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbd68-0b71-4f78-8d62-fdeb3f0e6ecd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:43.567740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:27:43.569382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.569848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.570298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.586891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:43.588421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:43.661405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:43.662599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:43.693440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcbd68-0b71-4f78-8d62-fdeb3f0e6ecd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:43.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:43.732970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.733463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.733950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.735040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] RBAC: Adding query filter params (name=member) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:43.735594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:43.737415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:43.747204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:43.748459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:43.793872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc6d78-bc25-490b-9267-a360556dbdb1 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:43.836004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:43.837088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.837378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.837654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.849216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672f097-9e08-4490-a8fe-159bea506708 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:43.851113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:43.860746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:43.861619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:43.862383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 37/70] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:43.863003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:43.892305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:43.893121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:43.893654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:43.893940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:43.907437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:43.918117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:43.919272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:43.920112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 34/71] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:27:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:43.920753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:43.966459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786e677-33b4-422b-b859-c23c1a023488 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.002834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9715d1-4fb8-4e16-974d-fdc4c4290135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.003742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9715d1-4fb8-4e16-974d-fdc4c4290135 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.004028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9715d1-4fb8-4e16-974d-fdc4c4290135 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.004302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9715d1-4fb8-4e16-974d-fdc4c4290135 None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.020432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9715d1-4fb8-4e16-974d-fdc4c4290135 None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.022017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9715d1-4fb8-4e16-974d-fdc4c4290135 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.028472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 38/72] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:43 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.028472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e588-e1a8-485d-b606-1a987cd006d5 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.028472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e588-e1a8-485d-b606-1a987cd006d5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.028472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339e588-e1a8-485d-b606-1a987cd006d5 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.028472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 39/73] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:44.028472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e588-e1a8-485d-b606-1a987cd006d5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.042034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baead2d-1ef3-49a3-b8e9-2974f98dd052 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.080488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.081421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.081842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.082257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.083561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:44.084313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.086363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.097494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 35/74] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.098672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.129834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339e588-e1a8-485d-b606-1a987cd006d5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.164765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.165437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.165714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.165992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.166749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:44.167055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.168542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52253bc3-d70b-4536-970b-b4ea9abab397 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.181041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 40/75] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.181041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.181041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.181041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.195803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:44.196966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:44.203411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9862-494a-450c-af9b-bf5078340a1d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.237500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cccc-dc8e-49c2-9690-0320337d7ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.238184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cccc-dc8e-49c2-9690-0320337d7ddf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.238488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cccc-dc8e-49c2-9690-0320337d7ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.238799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cccc-dc8e-49c2-9690-0320337d7ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.259851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 41/76] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:44.260776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.304264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24cccc-dc8e-49c2-9690-0320337d7ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.305741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24cccc-dc8e-49c2-9690-0320337d7ddf None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.354045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50813fb-4002-4931-bbb2-a0bcf3d37bf1 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.386198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.387058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.387341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.387626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.389072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.390521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.392166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 42/77] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.394037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.398414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 36/78] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:44.399743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75190-d082-44f8-b40d-7551e66da98a None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.400032 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75190-d082-44f8-b40d-7551e66da98a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.400305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75190-d082-44f8-b40d-7551e66da98a None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.401738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 37/79] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:44.404409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75190-d082-44f8-b40d-7551e66da98a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.486113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b57f2-8bcf-435e-bd02-fbe7953cd872 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.497263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75190-d082-44f8-b40d-7551e66da98a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.517959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.518819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.519108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.519380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.520598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.522033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.523661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 43/80] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.524422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.533615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.534402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.534684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.534960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.544605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:44.552686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:44.553550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:44.554383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 38/81] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:44.555083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.616402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363ad00-a30f-46c1-aea3-f40fb5198989 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.648061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.648701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.648981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.649253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.650375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62b886-5e96-43f1-b28d-c9ed583099dd None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.685498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf383f8-771c-4ece-9f16-2fd0ad86dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.686360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf383f8-771c-4ece-9f16-2fd0ad86dacd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.686648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf383f8-771c-4ece-9f16-2fd0ad86dacd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.686929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf383f8-771c-4ece-9f16-2fd0ad86dacd None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.688779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf383f8-771c-4ece-9f16-2fd0ad86dacd None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.690234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf383f8-771c-4ece-9f16-2fd0ad86dacd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.691970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 39/82] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.693122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.693417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.693694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.709498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:44.710682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:44.715587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.717074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.772476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 40/83] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:44.773300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.811586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 44/84] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:44.812471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.865406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c091da7-fa39-43df-90b7-afc5efc62b08 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.896539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.897108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.897389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.897665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.904877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5647be-98f7-41e7-9a4d-cdd7f657d401 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:44.937854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:44.938509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:44.938792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:44.939067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:44.939850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:44.940183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.941540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:44.949482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 45/85] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:44.954133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:44.972803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:44.974324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.050709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac81b00-4eda-4d0f-a055-8f559f22d759 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.067592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 41/86] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:45.068455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.081846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.082496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.082778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.083064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.083924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=f93ce690e2b3438bafd9444b82fa2e00) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:45.084237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.085674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.090877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 46/87] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:44 2022] GET /identity/v3/role_assignments?user.id=f93ce690e2b3438bafd9444b82fa2e00&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=d283c28c6467425d80d17a4b6dda137b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.091679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.171943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9e9e9-58b0-496a-8c1e-61c397d575d2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.203235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a916-3297-4db7-98d2-f501ac600a39 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.206886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.207716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.207999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.208274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.209482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.210963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.217608 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 42/88] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.217608 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.239396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.240288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.240570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.240847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.242100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.243575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.245359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 47/89] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.246140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.316234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99759cf3-183c-4eae-8377-6a6c0c652293 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.345891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f64f12-e0b3-409b-afc0-bc14a104512e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.349109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.349982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.350267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.350544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.351782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.353239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.359419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 43/90] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.359419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.379336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.380236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.380525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.380813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.381981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.383469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.385441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 48/91] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.390929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.455135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb113-e115-448e-9d7c-e499302f767c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.487267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.487451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493582b-c642-4e61-a437-64d5ce410197 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.487968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.488251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.488528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.489248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.490691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.521049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.521701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.522009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.522288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.523123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=a29ada27094d4702b47eeff209b1d340) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:45.523440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.524919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.530208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 49/92] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/role_assignments?user.id=a29ada27094d4702b47eeff209b1d340&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.530985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.637153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefc796-1a5c-4d1e-a034-e9bf528aa25a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.672699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.673369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.673658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.673939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.689621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 44/93] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:27:45 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:45.691028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.749195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.751280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.806259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc0ee9-6de9-4e19-bfac-a4238fd015d9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:45.844235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:45.845317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:45.845882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:45.846393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:45.847475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] RBAC: Adding query filter params (role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=f93ce690e2b3438bafd9444b82fa2e00) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:45.848010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:45.849677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:45.858608 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/role_assignments?user.id=f93ce690e2b3438bafd9444b82fa2e00&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=01fa319c34404bab84538eca6b902bdb => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:45.868095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 50/95] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:45.873619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:45.998659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4a7e-d803-4bac-a72e-98b0a29c2f64 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:46.039575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ecc4e-e315-418c-ae1d-803fe009b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:46.040396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ecc4e-e315-418c-ae1d-803fe009b755 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:46.040677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ecc4e-e315-418c-ae1d-803fe009b755 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:46.040953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ecc4e-e315-418c-ae1d-803fe009b755 None admin] PATH_INFO: `/v3/projects/58bc34a1bfb14469be08423bc57aa0cf` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:46.042845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ecc4e-e315-418c-ae1d-803fe009b755 None admin] RBAC: Authorizing `identity:get_project(project_id=58bc34a1bfb14469be08423bc57aa0cf)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:46.044394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ecc4e-e315-418c-ae1d-803fe009b755 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:46.046197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:45 2022] GET /identity/v3/projects/58bc34a1bfb14469be08423bc57aa0cf => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:46.052995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:46.160134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409576-b0f7-4fbe-8570-7e56a89c6552 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:46.194732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:46.195402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:46.195718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:46.196001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:46.196846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=58bc34a1bfb14469be08423bc57aa0cf, user.id=f93ce690e2b3438bafd9444b82fa2e00) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:46.197162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:46.198626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245111c-0fb0-4328-8ca9-de414060d8be None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:46.204790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:46 2022] GET /identity/v3/role_assignments?user.id=f93ce690e2b3438bafd9444b82fa2e00&scope.project.id=58bc34a1bfb14469be08423bc57aa0cf&role.id=d283c28c6467425d80d17a4b6dda137b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:47.438331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334413-5cef-420d-b5e3-8978f9e1d5cd None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:47.439218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334413-5cef-420d-b5e3-8978f9e1d5cd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:47.439218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8334413-5cef-420d-b5e3-8978f9e1d5cd None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:47.440284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:47.445669 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:47.446165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:47.446363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:47.469203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:47.470399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:47.545322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:47.579248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334413-5cef-420d-b5e3-8978f9e1d5cd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:47.699318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8334413-5cef-420d-b5e3-8978f9e1d5cd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:47.740507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:47.741617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:47.742050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:47.742473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:47.755450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:47.768561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:47.769665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:47.771278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:47.774966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 48/100] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:47.780399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:47.909761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607dda0-1b49-4f8c-a90c-b716d69b51d2 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:47.945045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:47.945721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:47.946008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:47.946287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:47.947055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:47.947365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:47.948790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:47.957641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 53/101] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:47.963133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:48.095349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dad1cd-3513-4a1d-9a68-2131f46300e9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:48.142554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:48.143440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.143763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.144045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.148412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:48.149892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:48.151566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 49/102] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:47 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:48.157959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:48.297948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777aa8e-7d31-43a0-8e51-71d99b2a8e96 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:48.332216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99833b9-27f7-401e-8a67-7f19a460be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:48.333088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99833b9-27f7-401e-8a67-7f19a460be5a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.333373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99833b9-27f7-401e-8a67-7f19a460be5a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.333651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99833b9-27f7-401e-8a67-7f19a460be5a None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.334880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99833b9-27f7-401e-8a67-7f19a460be5a None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:48.336365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99833b9-27f7-401e-8a67-7f19a460be5a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:48.338308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 54/103] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:48 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:48.344670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:48.433017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb32c7-3862-4bbd-bbed-6eecb620e2d4 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.433318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb32c7-3862-4bbd-bbed-6eecb620e2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.433583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb32c7-3862-4bbd-bbed-6eecb620e2d4 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.435270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 55/104] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:48.440168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.440458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.440742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.463200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:48.464423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:48.482942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427692-cfa0-4200-a12b-65df68956ce2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:48.554322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:48.556110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.558604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.558893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de/users/f93ce690e2b3438bafd9444b82fa2e00/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.563139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] RBAC: Authorizing `identity:create_grant(project_id=988e727f74e7410c973f04b479be26de, user_id=f93ce690e2b3438bafd9444b82fa2e00, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:48.565922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:48.590777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 56/105] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:48.616858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:48.670447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 50/106] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:27:48 2022] PUT /identity/v3/projects/988e727f74e7410c973f04b479be26de/users/f93ce690e2b3438bafd9444b82fa2e00/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:27:48.766614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756fb97-b01b-4b7c-a696-3785df9be935 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:48.813854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfc5d7-6f4d-4ff5-b43f-706515bbd7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:48.814589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc5d7-6f4d-4ff5-b43f-706515bbd7ac None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.814871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc5d7-6f4d-4ff5-b43f-706515bbd7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.815146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfc5d7-6f4d-4ff5-b43f-706515bbd7ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.826908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfc5d7-6f4d-4ff5-b43f-706515bbd7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-09cfc5d7-6f4d-4ff5-b43f-706515bbd7ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:48.835205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:48.836081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:48.837284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 57/107] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:48.842407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:48.963706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79027c92-b335-4125-927d-2e730b0a0030 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:48.988082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb01ea-aad6-4f0d-a698-d7d5527b1004 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:48.988401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb01ea-aad6-4f0d-a698-d7d5527b1004 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:48.988646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb01ea-aad6-4f0d-a698-d7d5527b1004 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:48.990157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 58/108] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:49.003223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.003223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.003223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.023183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:49.023899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.024183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.024457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.025220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:49.025526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:49.027298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:49.033440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:49.035490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:49.043983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 51/109] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:49.049611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.144047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 59/110] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:27:49.212297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.214625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb410e-fed2-4f6e-8085-640475b76d87 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:49.248396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:49.249270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.249554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.249831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.251672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:49.253547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:49.255596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 52/111] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:49 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:49.261767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.413724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d20f69-2c4b-4ebd-8999-63b5a2036751 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:49.433776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a0a57-fb1a-4986-8163-9a4eb569b798 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:49.450712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68fb1b-1831-4a36-b00f-e6c257f1959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:49.451569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68fb1b-1831-4a36-b00f-e6c257f1959a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.451877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68fb1b-1831-4a36-b00f-e6c257f1959a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.452152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68fb1b-1831-4a36-b00f-e6c257f1959a None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.453395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68fb1b-1831-4a36-b00f-e6c257f1959a None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:49.455277 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68fb1b-1831-4a36-b00f-e6c257f1959a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:49.457644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 53/112] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:49 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:49.458875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc864a-cde4-43c4-b1d4-16b84f1fc399 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.459164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc864a-cde4-43c4-b1d4-16b84f1fc399 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.459444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc864a-cde4-43c4-b1d4-16b84f1fc399 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.466664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 54/113] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:49.468335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc864a-cde4-43c4-b1d4-16b84f1fc399 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.514476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282ce92-faa2-4bd4-aef0-0384adee863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:49.515348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282ce92-faa2-4bd4-aef0-0384adee863c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.515655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282ce92-faa2-4bd4-aef0-0384adee863c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.515986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282ce92-faa2-4bd4-aef0-0384adee863c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.527173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282ce92-faa2-4bd4-aef0-0384adee863c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-5282ce92-faa2-4bd4-aef0-0384adee863c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:49.536054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:49.536925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:49.538103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 60/114] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:27:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:27:49.538729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.538808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.539106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.562801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:49.564954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:49.635739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 61/115] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:49.636656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.687061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc864a-cde4-43c4-b1d4-16b84f1fc399 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:49.739021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:49.740003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.740295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.740575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de/users/a29ada27094d4702b47eeff209b1d340/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.742621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] RBAC: Authorizing `identity:create_grant(project_id=988e727f74e7410c973f04b479be26de, user_id=a29ada27094d4702b47eeff209b1d340, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:49.744105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:49.782257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a0f2e-ef90-4ece-87ce-bd5e02c3d6a5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:49.816270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:49.816934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:49.817213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:49.817487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:49.818235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:49.818541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:49.819960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:49.828122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 62/116] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:49.828982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.884174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 55/117] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:27:49 2022] PUT /identity/v3/projects/988e727f74e7410c973f04b479be26de/users/a29ada27094d4702b47eeff209b1d340/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:27:49.885062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:49.964854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae14f1a-b104-4a3d-84cc-3ec28d6329fa None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.001527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.002335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.002615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.002889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.026512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:50.035966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:50.037000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:50.037771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:50.038717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 63/118] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:50.050668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.150350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b8f00-dfb3-4afa-b304-46dad584b704 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.191399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dae2f-6104-483d-925e-c9a8bbaf9621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.192407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dae2f-6104-483d-925e-c9a8bbaf9621 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.192692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dae2f-6104-483d-925e-c9a8bbaf9621 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.192970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dae2f-6104-483d-925e-c9a8bbaf9621 None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.194428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dae2f-6104-483d-925e-c9a8bbaf9621 None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:50.196547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2dae2f-6104-483d-925e-c9a8bbaf9621 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:50.198701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 56/119] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:49 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:50.204922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011979-41c7-4d1a-bec0-852a56de348d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.205212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011979-41c7-4d1a-bec0-852a56de348d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.205493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011979-41c7-4d1a-bec0-852a56de348d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.206938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 57/120] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:50.207661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f011979-41c7-4d1a-bec0-852a56de348d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.219570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf5cf1-57e7-448d-9c06-ef352fa02bb6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.270827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.272041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.272870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.273633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.274753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:50.275590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:50.277644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce84c7-8edc-4c9c-aa53-ce28988f3666 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:50.289393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 64/121] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:50.294301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.294301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.294301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.314837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:50.316541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:50.320785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f011979-41c7-4d1a-bec0-852a56de348d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.354765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f728b0-a35c-4108-83e2-325b0aaf46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.355873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f728b0-a35c-4108-83e2-325b0aaf46a7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.356405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f728b0-a35c-4108-83e2-325b0aaf46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.356974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f728b0-a35c-4108-83e2-325b0aaf46a7 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.359168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f728b0-a35c-4108-83e2-325b0aaf46a7 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:50.361241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f728b0-a35c-4108-83e2-325b0aaf46a7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:50.363157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 58/122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:50.369232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0f80-9caa-4353-a473-ffa8809a309f None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.369673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0f80-9caa-4353-a473-ffa8809a309f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.370051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad0f80-9caa-4353-a473-ffa8809a309f None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.371688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 59/123] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:50.372399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0f80-9caa-4353-a473-ffa8809a309f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.402134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 65/124] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:50.403714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.503550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad0f80-9caa-4353-a473-ffa8809a309f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.536935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf19892-1433-4706-8447-3ee87c6470af None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.541487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d540d-64d8-4233-a4a0-b506552ea2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.542359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d540d-64d8-4233-a4a0-b506552ea2bd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.542640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d540d-64d8-4233-a4a0-b506552ea2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.542916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d540d-64d8-4233-a4a0-b506552ea2bd None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.548292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d540d-64d8-4233-a4a0-b506552ea2bd None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:50.550545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d540d-64d8-4233-a4a0-b506552ea2bd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:50.553314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 60/125] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:50.554711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938001-b27b-413d-985f-967544d8ba9a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.555213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938001-b27b-413d-985f-967544d8ba9a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.555726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938001-b27b-413d-985f-967544d8ba9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.578149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-00938001-b27b-413d-985f-967544d8ba9a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:50.580615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-00938001-b27b-413d-985f-967544d8ba9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:50.580723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.581609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.582071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.582486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de/users/f93ce690e2b3438bafd9444b82fa2e00/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.585595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] RBAC: Authorizing `identity:create_grant(project_id=988e727f74e7410c973f04b479be26de, user_id=f93ce690e2b3438bafd9444b82fa2e00, role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:50.587341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:50.647863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 61/126] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:50.648504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938001-b27b-413d-985f-967544d8ba9a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.698737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 66/127] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:27:50 2022] PUT /identity/v3/projects/988e727f74e7410c973f04b479be26de/users/f93ce690e2b3438bafd9444b82fa2e00/roles/01fa319c34404bab84538eca6b902bdb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:27:50.699615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.762507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938001-b27b-413d-985f-967544d8ba9a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.814535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.815432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.822465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.822465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.842443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:50.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:50.863566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:50.864824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.905725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446032f-2777-4924-99e9-38a37bdf8f5f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:50.944000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:50.944875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:50.945220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:50.945497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] PATH_INFO: `/v3/projects/58bc34a1bfb14469be08423bc57aa0cf` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:50.946774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] RBAC: Authorizing `identity:get_project(project_id=58bc34a1bfb14469be08423bc57aa0cf)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:50.948597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:50.950522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 67/129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/projects/58bc34a1bfb14469be08423bc57aa0cf => generated 312 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:50.955255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:50.990494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fd302-1d28-402f-aaea-2e478a333fec None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:51.030577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:51.031468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.032064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.032503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.033947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:51.036842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:51.040021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 63/130] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:51.040885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:51.070651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea523b-a658-4817-bf98-f56e95261d12 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:51.104560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:51.105463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.105917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.106349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.107256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:51.107729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:51.109280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:51.118470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 68/131] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:51.119487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:51.153821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6c5f8-38f7-4142-ad3e-a24cae2f3b2e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:51.189479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:51.190541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.190930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.191274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] PATH_INFO: `/v3/projects/58bc34a1bfb14469be08423bc57aa0cf/users/f93ce690e2b3438bafd9444b82fa2e00/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.193444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=58bc34a1bfb14469be08423bc57aa0cf, user_id=f93ce690e2b3438bafd9444b82fa2e00, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:51.195071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:51.228009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cbb91-2906-43fb-be6e-af495d3a2468 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:51.262870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:51.264111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.264575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.265029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.265948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:51.267635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:51.297832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 64/132] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:27:51 2022] PUT /identity/v3/projects/58bc34a1bfb14469be08423bc57aa0cf/users/f93ce690e2b3438bafd9444b82fa2e00/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:27:51.297832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:51.364547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 69/133] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:27:51 2022] POST /identity/v3/projects => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:51.439072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344f42a-577b-42fa-8144-d9df843d27f7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:51.477614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:51.478762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.479193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.479632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] PATH_INFO: `/v3/users/10fc5be2f3004978953e33c2854cc09b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.497391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] RBAC: Authorizing `identity:get_user(user_id=10fc5be2f3004978953e33c2854cc09b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:51.499222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:51.501356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 65/134] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:51 2022] GET /identity/v3/users/10fc5be2f3004978953e33c2854cc09b => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:51.508798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:51.632857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6be25d-66ab-4cdd-9201-3a7384bdeb9e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:51.671674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4747c-1e65-449d-ac93-72ab51df9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:51.672666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4747c-1e65-449d-ac93-72ab51df9c37 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.673109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4747c-1e65-449d-ac93-72ab51df9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.673527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4747c-1e65-449d-ac93-72ab51df9c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.745887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4747c-1e65-449d-ac93-72ab51df9c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:51.747670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4747c-1e65-449d-ac93-72ab51df9c37 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:51.865268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 70/135] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:51.871487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:51.909809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e83f-1789-45b6-be10-7cf4bc56f7e3 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.910104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e83f-1789-45b6-be10-7cf4bc56f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.910298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0e83f-1789-45b6-be10-7cf4bc56f7e3 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.912009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 71/136] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:51.922410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:51.922689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:51.922976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:51.954012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:51.957753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:52.042969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df588398-f24c-4ed3-996d-c1ae8132e8a9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:52.081995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 72/137] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:27:52.098026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:52.098895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:52.099180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:52.099465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:52.100694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:52.102163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:52.104067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 66/138] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:51 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:52.109748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:52.136062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:52.278647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc549-4206-4502-8a7e-59198f7375a1 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:52.310364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386a1c1-dc20-4eec-9996-2f06214f2342 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:52.352545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:52.353214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:52.353500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:52.353784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:52.354626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] RBAC: Adding query filter params (role.id=320747637b1046cba6f9911c870ba2de, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=10fc5be2f3004978953e33c2854cc09b) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:52.354944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:52.361010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:52.367549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 73/139] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:52 2022] GET /identity/v3/role_assignments?user.id=10fc5be2f3004978953e33c2854cc09b&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=320747637b1046cba6f9911c870ba2de => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:52.383321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:52.384168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:52.384452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:52.384731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:52.405544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:52.413315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:52.414177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:52.414938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 67/140] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:27:52.420759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:52.557271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce63640-f47a-495b-b9ea-65cbc4ae455e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:52.593090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:52.593804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:52.594672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:52.594961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:52.595779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:52.596093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:52.597526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:52.606940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 74/141] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:52.612266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:52.755209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23beda56-df43-4ae1-b227-2a9fcd1532f9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:52.794712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:52.795595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:52.795923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:52.796203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:52.797461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:52.798930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:52.800603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 68/142] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:52 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:52.806383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:52.957373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed518cb-c955-4a8f-8f8c-efb3a8de6fb1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:53.010946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701a6d-c910-4f08-8232-d9b108a1a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:53.011689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701a6d-c910-4f08-8232-d9b108a1a7ff None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.011978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701a6d-c910-4f08-8232-d9b108a1a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.012259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701a6d-c910-4f08-8232-d9b108a1a7ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.099627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701a6d-c910-4f08-8232-d9b108a1a7ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:53.101111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701a6d-c910-4f08-8232-d9b108a1a7ff None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:53.223893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 75/143] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:53.229299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:53.369845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d325f-96e9-435d-b735-6aeb65ea8a34 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.370472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d325f-96e9-435d-b735-6aeb65ea8a34 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.370951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d325f-96e9-435d-b735-6aeb65ea8a34 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.372820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 76/144] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:53.375077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82fa87-cbbe-4a6e-94e7-2f15dabebaeb None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:53.379030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.379496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.380038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.428630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:53.430097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:53.472449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:53.473327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.473613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.473889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.479686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:53.479686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:53.483715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 69/145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:53 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:53.490562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:53.577709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 77/146] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:53.613741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:53.688181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d996a5-9bce-4930-82c4-73362f66a9c2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:53.748380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:53.749261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.749708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.750152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.751131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=f93ce690e2b3438bafd9444b82fa2e00) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:53.751592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:53.753182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6af94ea-1722-4bdf-aef7-fcb82f9e1ba1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:53.753687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af6252-1260-4967-8097-4da97d600bb4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:53.767976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 70/147] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:53 2022] GET /identity/v3/role_assignments?user.id=f93ce690e2b3438bafd9444b82fa2e00&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=d283c28c6467425d80d17a4b6dda137b => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:53.769467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdc6d-93ba-4645-819a-10a0e5d2c280 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.769758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdc6d-93ba-4645-819a-10a0e5d2c280 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.770040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdc6d-93ba-4645-819a-10a0e5d2c280 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.771379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 71/148] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:53.777082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.777372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.777655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.805547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:53.805547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:53.810358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:53.811885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:53.812434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:53.812994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:53.835150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:53.847637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:53.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:53.849319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:53.852342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 78/149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:53.857629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:53.877967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 72/150] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:27:53.901380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.002588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c42b9b-e0f6-48e4-b2de-c945d9b8794f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.038529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.039352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.039661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.039943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.051355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:54.059562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:54.060444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:54.061223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 73/151] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:27:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:54.066875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.085886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b4b04-1ed8-44ca-aaa9-8a851b68dcc0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.170602 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b8306-929c-483b-8e54-3d60bef2a913 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.181513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.182199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.182481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.182758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.183524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:54.183860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.185260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.206058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.206249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 79/152] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:54.206492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.206765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.207050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.207828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:54.208138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.209523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.211302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.225901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 74/153] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:54.234521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.377315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d5b0e-6954-449d-b7f1-780e07dabc0c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.411432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.412341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.412629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.412950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] PATH_INFO: `/v3/users/a29ada27094d4702b47eeff209b1d340` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.414123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] RBAC: Authorizing `identity:get_user(user_id=a29ada27094d4702b47eeff209b1d340)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.415571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.417202 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 80/154] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/users/a29ada27094d4702b47eeff209b1d340 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:54.418264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f095333-02a3-41f9-a177-0bde078a9a50 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.423225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.473845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.474727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.475009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.475283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.480790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.482271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.483991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 75/155] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:54.492521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.584656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572a7d-a351-4276-92a9-6973b6240c09 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.622416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf6013-3261-41ba-89e5-e38e492a8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.623066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6013-3261-41ba-89e5-e38e492a8030 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.623344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6013-3261-41ba-89e5-e38e492a8030 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.623646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf6013-3261-41ba-89e5-e38e492a8030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.650294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782162-1f87-4e80-bb41-afb7942caca4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.683747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df305cc3-ae63-4566-b3d6-ce8cad5a2de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.684405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305cc3-ae63-4566-b3d6-ce8cad5a2de2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.684691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305cc3-ae63-4566-b3d6-ce8cad5a2de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.684965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df305cc3-ae63-4566-b3d6-ce8cad5a2de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.692794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6013-3261-41ba-89e5-e38e492a8030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.694262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf6013-3261-41ba-89e5-e38e492a8030 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.752507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305cc3-ae63-4566-b3d6-ce8cad5a2de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.753966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df305cc3-ae63-4566-b3d6-ce8cad5a2de2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.794316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 81/156] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:54.800124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea77af8-dcf6-4b3a-aa1d-f4fd7fa1bdef None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.800458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea77af8-dcf6-4b3a-aa1d-f4fd7fa1bdef None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.800741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea77af8-dcf6-4b3a-aa1d-f4fd7fa1bdef None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.802218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 82/157] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:54.803070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea77af8-dcf6-4b3a-aa1d-f4fd7fa1bdef None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.852112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 76/158] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:54.853404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625035a-7355-48cd-b899-87208d47e91d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.853691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625035a-7355-48cd-b899-87208d47e91d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.853973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625035a-7355-48cd-b899-87208d47e91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.873245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2625035a-7355-48cd-b899-87208d47e91d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:54.874412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2625035a-7355-48cd-b899-87208d47e91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:54.922402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea77af8-dcf6-4b3a-aa1d-f4fd7fa1bdef None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:54.945882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 77/159] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:54.946575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625035a-7355-48cd-b899-87208d47e91d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:54.973813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:54.975155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:54.975764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:54.976624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:54.978496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:54.980715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:54.983887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 83/160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:54.989924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.053733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625035a-7355-48cd-b899-87208d47e91d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.092636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.093498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.093778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.094102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.095287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.096745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.097495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc6aff-2b67-4fb7-82e8-039515f35b47 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.103412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 78/161] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:55.104339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.132232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.133253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.133692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.134100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.145589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:55.155489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:55.156462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:27:55.157305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:55.157883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 84/162] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:55.158221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.202511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133db666-53b6-4bc8-8b7c-8e71fe7ac796 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.237136 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.237835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.238109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.238403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.239246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=a29ada27094d4702b47eeff209b1d340) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:55.239556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.241071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347a35b-2a27-490c-9662-b8d8d81db36c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.254408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 79/163] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/role_assignments?user.id=a29ada27094d4702b47eeff209b1d340&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:55.254408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e2f7-3d10-4807-9898-14ea22b0dc9e None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.254408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e2f7-3d10-4807-9898-14ea22b0dc9e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.254408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e2f7-3d10-4807-9898-14ea22b0dc9e None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.254408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 80/164] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:55.255457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031e2f7-3d10-4807-9898-14ea22b0dc9e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.276476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27491b5f-b3bf-4332-9193-126c888f3ce2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.315163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.316296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.316859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.317361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.318440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] RBAC: Adding query filter params (role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=f93ce690e2b3438bafd9444b82fa2e00) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:55.318899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.320640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f901b-a805-4bb5-861b-40eb868caad4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.327659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 85/165] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/role_assignments?user.id=f93ce690e2b3438bafd9444b82fa2e00&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=01fa319c34404bab84538eca6b902bdb => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:55.334906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986055d2-fff1-4ffe-a380-a36e6f53291e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.335350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986055d2-fff1-4ffe-a380-a36e6f53291e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.335791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986055d2-fff1-4ffe-a380-a36e6f53291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.372018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-986055d2-fff1-4ffe-a380-a36e6f53291e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:55.373308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-986055d2-fff1-4ffe-a380-a36e6f53291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:55.393883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031e2f7-3d10-4807-9898-14ea22b0dc9e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.473130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.474165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.474680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.475126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.476130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] RBAC: Adding query filter params (name=member) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:55.476649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.478252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.489106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 81/166] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:55.495014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.525150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 86/167] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:55.544047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc460-f600-49c7-b3eb-d802c5aeda66 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.544379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc460-f600-49c7-b3eb-d802c5aeda66 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.544656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc460-f600-49c7-b3eb-d802c5aeda66 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.546094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 87/168] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:55.552405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.552687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.552958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.572036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:55.573336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:55.618940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03d47-fa20-4081-bf63-bf23ebc1d77b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.654777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 88/169] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:55.655708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.659800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.660677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.660958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.661232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] PATH_INFO: `/v3/users/f93ce690e2b3438bafd9444b82fa2e00` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.662431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] RBAC: Authorizing `identity:get_user(user_id=f93ce690e2b3438bafd9444b82fa2e00)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.663918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.665676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 82/170] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/users/f93ce690e2b3438bafd9444b82fa2e00 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:55.671057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.747697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb84ca1-41e9-46a1-af3e-f809dfef1e7b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.763660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625ebb8-000b-49bb-b19a-e4759443205a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.779765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.780544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.780816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.781084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.782293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.783853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.785438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 89/171] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:55.786192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.795861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.796500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.796785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.797214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.860088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:55.861539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:55.877552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc6218-99c8-4038-91c3-bc149a1adee4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:55.909286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:55.910050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:55.910329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:55.910596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:55.920140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:55.927647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:55.928913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 90/172] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:55.929848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:55.954055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 83/173] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:27:55.954885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:56.024176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afed9a-330c-4681-a740-1bf39c4714bd None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.046702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c459b5-7ea1-42ca-92c0-bb063a6b22d9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.055164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.055841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.056122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.056397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.057101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.058542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.079023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.079722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.080004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.080276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.081025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:56.081330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.082704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.090567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 84/174] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:27:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:56.091418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:56.155240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 91/175] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:27:55 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:56.162870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:56.187869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e38e-b587-4f57-ae9a-d6c5bfdab780 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.223403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.224309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.224584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.224851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] PATH_INFO: `/v3/projects/58bc34a1bfb14469be08423bc57aa0cf` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.226156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] RBAC: Authorizing `identity:get_project(project_id=58bc34a1bfb14469be08423bc57aa0cf)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.227769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.229505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 85/176] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:56 2022] GET /identity/v3/projects/58bc34a1bfb14469be08423bc57aa0cf => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:56.236727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:56.272910 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ea87-3fc9-4bb6-965f-f05b5bc65bc1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.307047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.307863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.308144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.308419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] PATH_INFO: `/v3/users/10fc5be2f3004978953e33c2854cc09b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.309787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] RBAC: Authorizing `identity:get_user(user_id=10fc5be2f3004978953e33c2854cc09b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.311280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.313809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 92/177] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:56 2022] GET /identity/v3/users/10fc5be2f3004978953e33c2854cc09b => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:56.319149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:56.341743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d079-fe7c-4e98-a65f-8a67670e682f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.384236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.385037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.385421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.385706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.386577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=58bc34a1bfb14469be08423bc57aa0cf, user.id=f93ce690e2b3438bafd9444b82fa2e00) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:56.386894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.388630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.395088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 86/178] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:27:56 2022] GET /identity/v3/role_assignments?user.id=f93ce690e2b3438bafd9444b82fa2e00&scope.project.id=58bc34a1bfb14469be08423bc57aa0cf&role.id=d283c28c6467425d80d17a4b6dda137b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:56.441894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b48f8c-b3b1-4a32-81bf-f316cbe407d6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.484100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14de98-b687-42e2-8ae6-a02d8f29f46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.485832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14de98-b687-42e2-8ae6-a02d8f29f46a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.486105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14de98-b687-42e2-8ae6-a02d8f29f46a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.486376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14de98-b687-42e2-8ae6-a02d8f29f46a None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.487847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14de98-b687-42e2-8ae6-a02d8f29f46a None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.489310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14de98-b687-42e2-8ae6-a02d8f29f46a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.491256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 93/179] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:56 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:27:56.497213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:56.611896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2f8f1-93d7-4272-a19c-dad5ca3aee8f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:56.651763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ef1ec-bfa0-47fb-a2f0-85781488f859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:56.652673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef1ec-bfa0-47fb-a2f0-85781488f859 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:56.652955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef1ec-bfa0-47fb-a2f0-85781488f859 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:56.653232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ef1ec-bfa0-47fb-a2f0-85781488f859 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de/users/10fc5be2f3004978953e33c2854cc09b/roles/320747637b1046cba6f9911c870ba2de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:56.655278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ef1ec-bfa0-47fb-a2f0-85781488f859 None admin] RBAC: Authorizing `identity:create_grant(project_id=988e727f74e7410c973f04b479be26de, user_id=10fc5be2f3004978953e33c2854cc09b, role_id=320747637b1046cba6f9911c870ba2de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:56.657571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ef1ec-bfa0-47fb-a2f0-85781488f859 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:56.753510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 87/180] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:27:56 2022] PUT /identity/v3/projects/988e727f74e7410c973f04b479be26de/users/10fc5be2f3004978953e33c2854cc09b/roles/320747637b1046cba6f9911c870ba2de => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:27:58.546461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65a129-60d5-4364-bb15-0e495a32f798 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.547030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65a129-60d5-4364-bb15-0e495a32f798 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.547030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65a129-60d5-4364-bb15-0e495a32f798 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.548529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 94/181] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:58.554300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e2427-736e-4839-b51f-00c24e0d831f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.554819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e2427-736e-4839-b51f-00c24e0d831f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.554819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e2427-736e-4839-b51f-00c24e0d831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.573142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-466e2427-736e-4839-b51f-00c24e0d831f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:58.574361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-466e2427-736e-4839-b51f-00c24e0d831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:58.648463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 88/182] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:58.671370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65a129-60d5-4364-bb15-0e495a32f798 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:58.745440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc06b6-3bed-45b4-b4e7-bbed01b64bef None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.746061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc06b6-3bed-45b4-b4e7-bbed01b64bef None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.746536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc06b6-3bed-45b4-b4e7-bbed01b64bef None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.748150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 89/183] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:27:58.755093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7b2b-06ed-49d3-8d29-c11436e9d0a2 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.755383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7b2b-06ed-49d3-8d29-c11436e9d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.755657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd7b2b-06ed-49d3-8d29-c11436e9d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.776968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8ebd7b2b-06ed-49d3-8d29-c11436e9d0a2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:58.778583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8ebd7b2b-06ed-49d3-8d29-c11436e9d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:58.782030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65a129-60d5-4364-bb15-0e495a32f798 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:58.815722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70942029-355b-449b-9ee5-0ac8e04e7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:58.816830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942029-355b-449b-9ee5-0ac8e04e7dec None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.817181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942029-355b-449b-9ee5-0ac8e04e7dec None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.818248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70942029-355b-449b-9ee5-0ac8e04e7dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.827802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70942029-355b-449b-9ee5-0ac8e04e7dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-70942029-355b-449b-9ee5-0ac8e04e7dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:58.836209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:58.837163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:27:58.837954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 95/184] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:58.844488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187583e-44f8-41cf-98d0-1f3cd3b3e039 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.844488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187583e-44f8-41cf-98d0-1f3cd3b3e039 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.844488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187583e-44f8-41cf-98d0-1f3cd3b3e039 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.844488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 96/185] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:58.846016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187583e-44f8-41cf-98d0-1f3cd3b3e039 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:58.852944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 90/186] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:27:58.854379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.854675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.854955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.873426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:58.874603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:58.940263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 91/187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:58.941134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:58.960069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187583e-44f8-41cf-98d0-1f3cd3b3e039 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:58.996747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:58.997420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:58.997704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:58.998327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:58.998737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:58.999047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.001007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.009761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 97/188] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:59.010503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.058969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6816de9-57bb-4293-b511-33c8741f5ebf None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.090514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.091238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.091513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.091816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.104875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:59.105442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c8797-e449-432a-b420-517be247d0c3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:59.114225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:59.115325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:59.116168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 92/189] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:27:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:59.116823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.142963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479354f8-58d8-401d-a2c6-31950738d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.143832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479354f8-58d8-401d-a2c6-31950738d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.144112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479354f8-58d8-401d-a2c6-31950738d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.144381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479354f8-58d8-401d-a2c6-31950738d2b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.145518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479354f8-58d8-401d-a2c6-31950738d2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.146949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479354f8-58d8-401d-a2c6-31950738d2b6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.148558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 98/190] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:59.149734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d1fd-8a27-4352-be0b-14153ec5f290 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.150058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d1fd-8a27-4352-be0b-14153ec5f290 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.150331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d1fd-8a27-4352-be0b-14153ec5f290 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.151594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 99/191] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:27:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:27:59.153420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d1fd-8a27-4352-be0b-14153ec5f290 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.213642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88661ad3-55ca-4724-a13a-505e2c05ad03 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.244502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.245356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.245636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.245915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] PATH_INFO: `/v3/users/62bc32003a37458183f65b032006ce90` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.246976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d1fd-8a27-4352-be0b-14153ec5f290 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.258708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] RBAC: Authorizing `identity:get_user(user_id=62bc32003a37458183f65b032006ce90)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.260199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.261836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 93/192] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/users/62bc32003a37458183f65b032006ce90 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:59.262573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.280037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.280690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.280970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.281266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.282187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:27:59.282494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.283883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ef4ce-c270-4dcd-9706-2889e0c54846 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.291549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 100/193] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:59.293899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.294186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.294462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.310349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:27:59.311511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:27:59.357358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94daf8-573d-447d-aacd-806e28e1a726 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.383143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 101/194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:27:59.383855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.390827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.391492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.391800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.392075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.392786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.394212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.476021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922a5b-47e2-4523-b2ca-ec42f76ebaf3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.503651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 94/195] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:27:59 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:27:59.503651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.517745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.518395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.518988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.519093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.590696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.592389 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.608370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f256a3-b968-4f97-bdec-97f33a686130 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.643934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.644814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.645088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.645358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] PATH_INFO: `/v3/users/62bc32003a37458183f65b032006ce90` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.646715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] RBAC: Authorizing `identity:get_user(user_id=62bc32003a37458183f65b032006ce90)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.648233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.649958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 95/196] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/users/62bc32003a37458183f65b032006ce90 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:27:59.652705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.698034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 102/197] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:27:59.699202 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.768062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4144448-46f9-4e76-9859-fd7eb1f1e408 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.812422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.813329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.813588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.813821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.825639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f27e9d-a063-4616-8e57-8cc37db6c03a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:27:59.827861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:27:59.838173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:27:59.839090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:27:59.839933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:27:59.840546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 96/198] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:27:59.843636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:27:59.864754 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:27:59.865324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:27:59.865600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:27:59.865869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:27:59.933955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:27:59.935419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:27:59.965730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab3bf-3327-43d3-a8e8-139c5fd0f937 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.011871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.012976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.013664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.014108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.015477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.018098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.020817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 97/199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:00.021883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.049565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 103/200] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:00.050669 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.139914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a768abe-6eb4-437b-9991-0532d7158f97 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.161803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f1120-404c-4fec-871e-5934eb305315 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.181097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.182335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.183038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.183459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.184855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:00.185571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.188114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.195225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.195911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.196217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.196449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.197273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=62bc32003a37458183f65b032006ce90) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:00.197579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.198610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 98/201] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:00.199358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.199709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.205249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 104/202] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/role_assignments?user.id=62bc32003a37458183f65b032006ce90&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:00.206091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.318039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ff46c-b821-4dac-8961-b99ae0fb07f2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.325401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9a567-2183-4acb-97a3-0e39752e73a6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.367632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.367632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.367632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.367632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.368084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.368084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.368084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 99/203] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:00.371866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.372416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.373182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.373605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.374041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] PATH_INFO: `/v3/users/10fc5be2f3004978953e33c2854cc09b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.376201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] RBAC: Authorizing `identity:get_user(user_id=10fc5be2f3004978953e33c2854cc09b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.378694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.380807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 105/204] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/users/10fc5be2f3004978953e33c2854cc09b => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:00.388897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.478459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c38f55-4af3-4fbe-93f1-76c65c44f4dc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.515404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.516679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.517168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.517282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.518087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] RBAC: Adding query filter params (role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=62bc32003a37458183f65b032006ce90) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:00.518404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.519929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.534180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cbba5-4e45-4e69-8a12-ad4346bc099a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.541770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 100/205] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/role_assignments?user.id=62bc32003a37458183f65b032006ce90&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=01fa319c34404bab84538eca6b902bdb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:00.580450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.581384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.581811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.582224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.659013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.661360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.766646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 106/206] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:00.772415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:00.892495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f18ac-413a-48b1-9537-a4357c7c62d0 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:00.940313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40516824-107a-4d1a-bd5e-c5aef51c3bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:00.941187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40516824-107a-4d1a-bd5e-c5aef51c3bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:00.941473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40516824-107a-4d1a-bd5e-c5aef51c3bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:00.941752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40516824-107a-4d1a-bd5e-c5aef51c3bb9 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:00.942978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40516824-107a-4d1a-bd5e-c5aef51c3bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:00.944446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40516824-107a-4d1a-bd5e-c5aef51c3bb9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:00.946151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 101/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:00.951901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:01.077025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cb197-c27a-418c-ba11-e001d563391a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:01.115020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:01.115695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:01.115980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:01.116257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:01.117089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] RBAC: Adding query filter params (role.id=320747637b1046cba6f9911c870ba2de, scope.project.id=988e727f74e7410c973f04b479be26de, user.id=10fc5be2f3004978953e33c2854cc09b) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:01.117398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:01.118831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eec288-7d2a-4f27-a67d-388d8c8d8210 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:01.125530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 107/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:00 2022] GET /identity/v3/role_assignments?user.id=10fc5be2f3004978953e33c2854cc09b&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=320747637b1046cba6f9911c870ba2de => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:02.177363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20752b-f129-477d-8d4b-74195f89b005 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.177932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20752b-f129-477d-8d4b-74195f89b005 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.177932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20752b-f129-477d-8d4b-74195f89b005 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.179293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 102/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:02.184529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.185342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.185820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.202779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:02.204855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:02.248085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48af3-c31e-444a-adc8-183294ce8257 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.248713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48af3-c31e-444a-adc8-183294ce8257 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.249197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca48af3-c31e-444a-adc8-183294ce8257 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.250834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 103/210] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:02.256009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.256600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.257088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.273509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 108/211] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:02.275116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:02.276538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:02.296627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:02.346567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 104/212] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:02.370116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:02.405208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39519ba-1c2e-45e0-a49a-704f5e5b9927 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:02.439723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:02.441321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.442016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.442719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.459309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:02.469292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:02.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:02.471179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:02.471851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233fd0-6966-4bc8-9380-9bd628a4af04 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:02.473796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 109/213] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:02.480153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:02.512169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:02.513699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.514138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.514560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.517651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:02.519509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:02.521392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 105/214] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:02.527004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:02.583347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac6502-caa0-4ca6-8348-a9adaf9d8d49 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:02.617787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:02.618765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.619222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.619698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.620643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:02.621147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:02.622715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:02.627660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e902e-0a51-42d1-80a5-bbe0ee998059 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:02.631211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 110/215] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:02.640475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:02.665767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:02.666820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.667297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.667949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.671320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:02.671320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:02.745658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb51e6-9a20-430e-9049-cd64809f77e5 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:02.778542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b010fd-939d-4ddc-8615-e264d2fde6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:02.779371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b010fd-939d-4ddc-8615-e264d2fde6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.779617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b010fd-939d-4ddc-8615-e264d2fde6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.779898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b010fd-939d-4ddc-8615-e264d2fde6e2 None admin] PATH_INFO: `/v3/users/eb3a3022fe2145e3b86713961af483bc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.794695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b010fd-939d-4ddc-8615-e264d2fde6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb3a3022fe2145e3b86713961af483bc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:02.795651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 106/216] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:02 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:28:02.804923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b010fd-939d-4ddc-8615-e264d2fde6e2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:02.807078 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 111/217] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:02 2022] GET /identity/v3/users/eb3a3022fe2145e3b86713961af483bc => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:02.813030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:02.866452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c07a8-befe-44b0-a3b5-44d5da7fe6ce None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.866730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c07a8-befe-44b0-a3b5-44d5da7fe6ce None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.867012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c07a8-befe-44b0-a3b5-44d5da7fe6ce None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.868838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 112/218] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:02.878255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.878557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.879200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:02.903631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:02.907763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:02.945316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6b19e-e5d0-40e3-ad0d-cee3586cdf87 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:02.991448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46734d9-3372-45c3-b732-8ccaeb17c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:02.992904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46734d9-3372-45c3-b732-8ccaeb17c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:02.993651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46734d9-3372-45c3-b732-8ccaeb17c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:02.994124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46734d9-3372-45c3-b732-8ccaeb17c6d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.006870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 113/219] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:03.030498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.080271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46734d9-3372-45c3-b732-8ccaeb17c6d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.081753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46734d9-3372-45c3-b732-8ccaeb17c6d3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.140550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb5c7-3c43-4a32-ad0c-a26e78a73f7b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.189172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.190752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.191165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.191587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.202358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:03.204034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 107/220] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:03.205391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763b514-3084-40db-918c-f1319249e286 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.205683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763b514-3084-40db-918c-f1319249e286 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.205963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763b514-3084-40db-918c-f1319249e286 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.207252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 108/221] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:03.212128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:03.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:03.214103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:03.214694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.214694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.214694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.219780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 114/222] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:03.220509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.235468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:03.237000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:03.304768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 109/223] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:03.305870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.325606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595afef6-a31b-477d-b68f-c8a17887dbc1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.359819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.360825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.361093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.361447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.362724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.364365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.366088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 115/224] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:03.367026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.411254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528828b-fe33-4bad-a6e8-736fbc8e4bda None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.445754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.446686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.447192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.447699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.448691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:03.449168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.450729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.459717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 110/225] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:03.460708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.478103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c8e02-dda3-4894-9a97-f7e7f3304b75 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.520722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.521874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.522356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.522859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.533214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:03.541781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:03.542685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:03.543483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:03.546038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 116/226] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:03.547638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.584321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2b88-9f9e-42bd-919e-e5260bea914f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.625832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.626625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.627261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.627542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.628552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=eb3a3022fe2145e3b86713961af483bc) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:03.628866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.630942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.638460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 111/227] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/role_assignments?user.id=eb3a3022fe2145e3b86713961af483bc&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=d283c28c6467425d80d17a4b6dda137b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:03.639457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.650107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5e145-469b-45c3-b8bb-bd4eb0d12a0e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.693363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.694714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.695013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.695287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] PATH_INFO: `/v3/users/62bc32003a37458183f65b032006ce90` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.697037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] RBAC: Authorizing `identity:get_user(user_id=62bc32003a37458183f65b032006ce90)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.698944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.701161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 117/228] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/users/62bc32003a37458183f65b032006ce90 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:03.707281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.761382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8863d4-55ae-4aac-9176-9e1c920b53e7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.797908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.798998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.799483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.800015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.800998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:03.801537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.803162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.813221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 112/229] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:03.819648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf479-8df2-4119-aa13-29df22d088a0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:03.820796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:03.889610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:03.893284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:03.893845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:03.894306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:03.895874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:03.898895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:03.907583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 118/230] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:03.909237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:04.000320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b194-0436-4b19-a39d-82f999fdd947 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:04.034503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:04.035783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:04.036261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:04.036755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] PATH_INFO: `/v3/users/62bc32003a37458183f65b032006ce90` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:04.038159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] RBAC: Authorizing `identity:get_user(user_id=62bc32003a37458183f65b032006ce90)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:04.039812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:04.041686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 113/231] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:03 2022] GET /identity/v3/users/62bc32003a37458183f65b032006ce90 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:04.052544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:04.091746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e6e31-4857-41fb-89c7-05bf6265baf4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:04.126971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe182f-a5ed-46d4-b7e3-2c45e530b205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:04.127993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe182f-a5ed-46d4-b7e3-2c45e530b205 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:04.128213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe182f-a5ed-46d4-b7e3-2c45e530b205 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:04.128484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe182f-a5ed-46d4-b7e3-2c45e530b205 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/62bc32003a37458183f65b032006ce90/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:04.131113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe182f-a5ed-46d4-b7e3-2c45e530b205 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7cfd425fdc4e30976571d2f413bcae, user_id=62bc32003a37458183f65b032006ce90, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:04.132735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe182f-a5ed-46d4-b7e3-2c45e530b205 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:04.171572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51f02-5e8e-4667-92de-4049e1694c72 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:04.206168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:04.207939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:04.208418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:04.208883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:04.210477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:04.212144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:04.214061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 114/232] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:04 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:04.220798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:04.226678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 119/233] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:03 2022] PUT /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/62bc32003a37458183f65b032006ce90/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:04.354075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3560216-7f65-45ee-9a97-77ebb5e5ee75 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:04.398949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87826eec-7299-445b-9b9a-c2878a904f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:04.400167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826eec-7299-445b-9b9a-c2878a904f34 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:04.400603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826eec-7299-445b-9b9a-c2878a904f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:04.401015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87826eec-7299-445b-9b9a-c2878a904f34 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/62bc32003a37458183f65b032006ce90/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:04.403540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826eec-7299-445b-9b9a-c2878a904f34 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7cfd425fdc4e30976571d2f413bcae, user_id=62bc32003a37458183f65b032006ce90, role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:04.405232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87826eec-7299-445b-9b9a-c2878a904f34 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:04.488678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 115/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:04 2022] PUT /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/62bc32003a37458183f65b032006ce90/roles/01fa319c34404bab84538eca6b902bdb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:28:05.438766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e2f8-4e3d-4a97-adbf-3d3f0b156c56 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:05.439306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e2f8-4e3d-4a97-adbf-3d3f0b156c56 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:05.439306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467e2f8-4e3d-4a97-adbf-3d3f0b156c56 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:05.440994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 120/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:05.446063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:05.446463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:05.446649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:05.467323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:05.468677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:05.550180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 116/236] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:05.590637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467e2f8-4e3d-4a97-adbf-3d3f0b156c56 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:05.723393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467e2f8-4e3d-4a97-adbf-3d3f0b156c56 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:05.757642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3918a8e-af22-47c0-9001-d18fbfdc1bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:05.758471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918a8e-af22-47c0-9001-d18fbfdc1bbc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:05.758752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918a8e-af22-47c0-9001-d18fbfdc1bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:05.759022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3918a8e-af22-47c0-9001-d18fbfdc1bbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:05.760399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3918a8e-af22-47c0-9001-d18fbfdc1bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:05.761934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3918a8e-af22-47c0-9001-d18fbfdc1bbc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:05.764441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 121/237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:05.770550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:05.926729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f87e-07d5-422a-adc3-5a7a455e8b74 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:05.957926 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5070-5ea3-44ce-bde4-0c051e493026 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:05.958260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5070-5ea3-44ce-bde4-0c051e493026 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:05.958528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a5070-5ea3-44ce-bde4-0c051e493026 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:05.959983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 122/238] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:05.965956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e20e-3b71-44cd-bfbb-14f21f15f06d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:05.966239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e20e-3b71-44cd-bfbb-14f21f15f06d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:05.966574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e20e-3b71-44cd-bfbb-14f21f15f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:05.971480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:05.972191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:05.972473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:05.972752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:05.973552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:05.974959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:06.003876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-05e1e20e-3b71-44cd-bfbb-14f21f15f06d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:06.005064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-05e1e20e-3b71-44cd-bfbb-14f21f15f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:06.074440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 117/239] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:05 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:06.084214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 123/240] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:06.123067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.268632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90761079-4fa3-4834-978e-4d3b80954564 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:06.304949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:06.305747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.306027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.306300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.309186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08be5-f3b9-436d-90b1-0e8ecf0caea9 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.309470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08be5-f3b9-436d-90b1-0e8ecf0caea9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.309743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a08be5-f3b9-436d-90b1-0e8ecf0caea9 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.311103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 124/241] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:06.316127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.316405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.316673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.326442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:06.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:06.335517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:06.336405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:06.337752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 118/242] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:06.344299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:06.344701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:06.345614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.451132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 125/243] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:06.463281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961bdb1-1196-4dbd-ac13-031270605804 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:06.477537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.507108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:06.508131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.508131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.508426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.509117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:06.509427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:06.510810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:06.523117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 119/244] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:06.528515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.602388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f178d73-35b9-451b-87af-3ee411a2e89c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:06.644923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:06.645961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.646401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.646797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.660128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:06.669644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:06.670558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:06.671338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:06.673692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 126/245] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:06.679551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.681487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e1ba-a21a-42f4-88ef-2020ad8d57d5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:06.725431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:06.726328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.726614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.726892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] PATH_INFO: `/v3/users/542544598a2d4dde8e303b1618aa04d3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.746895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] RBAC: Authorizing `identity:get_user(user_id=542544598a2d4dde8e303b1618aa04d3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:06.749297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:06.754066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 120/246] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/users/542544598a2d4dde8e303b1618aa04d3 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:06.761718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.857817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a120e0-0be4-46ec-8fef-d448db220740 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:06.920643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:06.921318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.921598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.921909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:06.922664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:06.922969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:06.925550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aec5e-2e6c-48c6-bb8c-fa3be0d33291 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:06.928111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:06.952324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 127/247] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:06.954140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:06.988098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:06.988098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:06.988098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:06.988098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.128578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:07.129995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:07.166897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe85a3-d942-4c79-9db9-ea0375c96bee None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:07.257492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:07.258387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.258670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.258946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] PATH_INFO: `/v3/users/eb3a3022fe2145e3b86713961af483bc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.261622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] RBAC: Authorizing `identity:get_user(user_id=eb3a3022fe2145e3b86713961af483bc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:07.263116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:07.269441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 128/248] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/users/eb3a3022fe2145e3b86713961af483bc => generated 297 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:07.271249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:07.355904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 121/249] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:07.362302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:07.473595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188b9b-ed3e-434d-99e0-400114e0ffe2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:07.508575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d0843-77fa-44d6-a2bb-29b3ff55854c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:07.516661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ec6f1-a2b3-42d4-8948-2969ad00e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:07.517531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec6f1-a2b3-42d4-8948-2969ad00e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.517817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec6f1-a2b3-42d4-8948-2969ad00e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.518097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ec6f1-a2b3-42d4-8948-2969ad00e5c7 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.521356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec6f1-a2b3-42d4-8948-2969ad00e5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:07.522740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ec6f1-a2b3-42d4-8948-2969ad00e5c7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:07.524722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 129/250] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:07 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:07.525818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea695a-b31d-4133-a57b-85b0d32e9429 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.526110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea695a-b31d-4133-a57b-85b0d32e9429 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.526387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea695a-b31d-4133-a57b-85b0d32e9429 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.527914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 130/251] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:07.535469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea695a-b31d-4133-a57b-85b0d32e9429 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:07.561179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87911aa5-08ea-4328-80a6-deb3ccec00dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:07.562419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911aa5-08ea-4328-80a6-deb3ccec00dd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.562896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911aa5-08ea-4328-80a6-deb3ccec00dd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.563360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87911aa5-08ea-4328-80a6-deb3ccec00dd None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.564805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911aa5-08ea-4328-80a6-deb3ccec00dd None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:07.566453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87911aa5-08ea-4328-80a6-deb3ccec00dd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:07.568694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 122/252] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:07 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:07.575648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.576045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.576339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.593192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:07.595045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:07.667631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 123/253] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:07.668738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:07.704280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea695a-b31d-4133-a57b-85b0d32e9429 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:07.737149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7f0d-a358-42cf-8aaf-72ec630ce384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:07.738370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7f0d-a358-42cf-8aaf-72ec630ce384 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.738792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7f0d-a358-42cf-8aaf-72ec630ce384 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.739213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7f0d-a358-42cf-8aaf-72ec630ce384 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/eb3a3022fe2145e3b86713961af483bc/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.741327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7f0d-a358-42cf-8aaf-72ec630ce384 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7cfd425fdc4e30976571d2f413bcae, user_id=eb3a3022fe2145e3b86713961af483bc, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:07.742932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7f0d-a358-42cf-8aaf-72ec630ce384 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:07.777137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736c160-3235-415d-a30c-58b6164159e4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:07.807219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 131/254] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:07 2022] PUT /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/eb3a3022fe2145e3b86713961af483bc/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:07.809064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cda331-e3c2-484e-a7a7-c7835ac3bc59 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.809660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cda331-e3c2-484e-a7a7-c7835ac3bc59 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.815319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cda331-e3c2-484e-a7a7-c7835ac3bc59 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.815458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:07.815554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 132/255] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:07.815660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.815660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.815812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cda331-e3c2-484e-a7a7-c7835ac3bc59 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:07.815911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.815911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] RBAC: Adding query filter params (role.id=320747637b1046cba6f9911c870ba2de, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=542544598a2d4dde8e303b1618aa04d3) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:07.815911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:07.816607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aad859-ea68-4e2b-9ded-c1099a7a2935 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:07.822987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 124/256] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:07 2022] GET /identity/v3/role_assignments?user.id=542544598a2d4dde8e303b1618aa04d3&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=320747637b1046cba6f9911c870ba2de => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:07.824556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.824846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.825120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:07.844500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:07.845933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:07.919102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 125/257] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:07.936498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cda331-e3c2-484e-a7a7-c7835ac3bc59 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:07.944891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:07.983335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:07.984703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:07.985241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:07.985774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.001080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:08.009872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:08.010845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:08.011684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:08.014683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 133/258] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:08.021993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.066405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d6733-7222-43d2-b03e-f1e7618d3fef None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.101725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.102561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.102836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.103104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.114809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:08.122651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:08.123830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:08.124698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:08.132177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 126/259] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:08.132177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.195635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f6c2-633d-4523-a359-5998e6cba8b2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.237741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15aa5dc-993d-4421-bc3e-d82e6d35beb0 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.247961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.248977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.249457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.250542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.251581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:08.252144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.253736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.269015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 134/260] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:08.273906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.274579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.274858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.275136 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.275581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.275945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:08.276251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.277764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.291267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 127/261] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:08.295660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.393672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716c878-1fc5-459c-bd26-8f5e5c19f422 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.403859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69977df-0939-4bc7-94b2-d0d9ec0fe381 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.427143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.428049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.428343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.428787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] PATH_INFO: `/v3/users/62bc32003a37458183f65b032006ce90` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.429792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] RBAC: Authorizing `identity:get_user(user_id=62bc32003a37458183f65b032006ce90)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.431210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.432860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 128/262] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/users/62bc32003a37458183f65b032006ce90 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:08.438833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.440196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.441329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.441809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.442290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] PATH_INFO: `/v3/users/62bc32003a37458183f65b032006ce90` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.443768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] RBAC: Authorizing `identity:get_user(user_id=62bc32003a37458183f65b032006ce90)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.445413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.447286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 135/263] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/users/62bc32003a37458183f65b032006ce90 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:08.452690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.538853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118bb18c-d4b7-434c-9884-7d9209040e8f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.559646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cea73c-c05d-40a3-b46f-a55cabf041f9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.572237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.572882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.573158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.573428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.595867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.596925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.597405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.597885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.641815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.643350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.670577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.672941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.746708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 129/264] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:08.748075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.775531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 136/265] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:08.784586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.851628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4c0f9-c0ad-4e5b-934a-1779fff01f10 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.879059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.879952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.880240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.880521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.881854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.883530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.890976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 130/266] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:08.892035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.915965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d1985-23db-4ea9-939c-ad213a9123ba None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:08.949919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:08.951149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:08.951660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:08.952145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:08.954145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:08.955825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:08.959045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 137/267] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:08.964731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:08.990610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508250-eafa-4300-88d3-ef2d48b1c442 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:09.025599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:09.026255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:09.026533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:09.026795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:09.027642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=62bc32003a37458183f65b032006ce90) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:09.027953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:09.029396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e28a5-aa67-4c31-93e0-5570b0ed7fea None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:09.039716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 131/268] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/role_assignments?user.id=62bc32003a37458183f65b032006ce90&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:09.078774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d8e4-3a71-4427-9dad-e0b83361f1c8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:09.117911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:09.118489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:09.118771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:09.119046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:09.119967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] RBAC: Adding query filter params (role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=62bc32003a37458183f65b032006ce90) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:09.120279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:09.121761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44ec95-ae83-471d-9daa-cc0743365fa7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:09.128689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 138/269] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:08 2022] GET /identity/v3/role_assignments?user.id=62bc32003a37458183f65b032006ce90&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=01fa319c34404bab84538eca6b902bdb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:09.814384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e0ea-214f-4a1b-ba5a-8ae13ff7a0ec None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:09.814923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e0ea-214f-4a1b-ba5a-8ae13ff7a0ec None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:09.815217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e0ea-214f-4a1b-ba5a-8ae13ff7a0ec None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:09.817216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 132/270] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:09.822877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:09.823411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:09.823411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:09.841049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:09.842231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:09.896800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367a387-e84e-46f4-98a5-24567d6db140 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:09.897116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367a387-e84e-46f4-98a5-24567d6db140 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:09.897361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367a387-e84e-46f4-98a5-24567d6db140 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:09.898958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 133/271] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:09.904701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:09.905012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:09.905261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:09.916608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 139/272] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:09.925388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:09.926792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:09.941779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:10.007672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 134/273] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:10.025030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:10.038186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8e4f4-d4f8-4898-9576-ea6cdab5ee2d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:10.071424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:10.072169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:10.072502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:10.072772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:10.073958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:10.075400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:10.082034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 140/274] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:10.084239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:10.135700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9e49-dec1-436b-8800-948aa444d700 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:10.175314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:10.176273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:10.176648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:10.177016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:10.189009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:10.199791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:10.200880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:10.201720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:10.202841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdc789-7f1b-4697-b47b-7e4ac6107ad7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:10.209250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 135/275] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:10.211664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:10.246817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:10.247488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:10.247800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:10.248073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:10.248935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:10.251495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:10.318258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d2ab-e6dd-4572-ab43-7cfc44227df0 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:10.340476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 141/276] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:10 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:10.367284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:10.368459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:10.368943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:10.369416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:10.370403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] RBAC: Adding query filter params (name=member) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:10.370951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:10.372665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:10.383512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 136/277] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:10.389829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:10.496769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ba9a-5d21-4cd3-a325-25e875ad3d86 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:10.537470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89461ebd-53c1-4684-a96d-c6f1bd8e7d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:10.538363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461ebd-53c1-4684-a96d-c6f1bd8e7d9c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:10.538642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461ebd-53c1-4684-a96d-c6f1bd8e7d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:10.538915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89461ebd-53c1-4684-a96d-c6f1bd8e7d9c None admin] PATH_INFO: `/v3/users/05e6f212f4e0420ab6ece142950f5ce0` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:10.555195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461ebd-53c1-4684-a96d-c6f1bd8e7d9c None admin] RBAC: Authorizing `identity:get_user(user_id=05e6f212f4e0420ab6ece142950f5ce0)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:10.556818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89461ebd-53c1-4684-a96d-c6f1bd8e7d9c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:10.558714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 142/278] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:10 2022] GET /identity/v3/users/05e6f212f4e0420ab6ece142950f5ce0 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:10.565738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:10.670034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a2b63-9c28-40bc-989c-f78d66ccd211 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:10.704789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:10.705450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:10.705731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:10.706004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:10.706842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, user.id=05e6f212f4e0420ab6ece142950f5ce0, scope.system=all) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:10.707151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:10.708605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583d515-349e-4d73-85bf-2a3af6b8b747 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:10.714044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 137/279] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 22:28:10 2022] GET /identity/v3/role_assignments?user.id=05e6f212f4e0420ab6ece142950f5ce0&scope.system=all&role.id=d283c28c6467425d80d17a4b6dda137b => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:11.005778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff43b8-d46a-4905-a410-917ae983bf50 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.006303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff43b8-d46a-4905-a410-917ae983bf50 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.006303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff43b8-d46a-4905-a410-917ae983bf50 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.007719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 143/280] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:11.014213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.014213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.014213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.045215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:11.046794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:11.067630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c287d-03f1-4e9c-b823-4906ff4a8512 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.067630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c287d-03f1-4e9c-b823-4906ff4a8512 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.067630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c287d-03f1-4e9c-b823-4906ff4a8512 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.067630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 144/281] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:11.086329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.086657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.086891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.115812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:11.117056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:11.120315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 138/282] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:11.142617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.238865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb7fba-bea6-4497-a0fc-66730abcc162 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:11.250534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 145/283] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:11.283804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:11.284599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.284876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.285144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.295366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:11.299491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:11.303359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:11.304263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:11.305058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:11.315672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 139/284] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:11.315672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.409066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba9558-9fe3-4315-b61c-7b921049700e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:11.441820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:11.442512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.442797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.443071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.443841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:11.444144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:11.445507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:11.458959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 140/285] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:11.460209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.521622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561e50b-8bef-468b-a22c-9dfae7cd3050 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:11.559483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2e3c0-be79-454a-980b-4331c2f30655 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:11.596845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:11.598026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:11.598930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.599211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.599482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] PATH_INFO: `/v3/users/542544598a2d4dde8e303b1618aa04d3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.599926 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.600192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.600452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.602010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] RBAC: Authorizing `identity:get_user(user_id=542544598a2d4dde8e303b1618aa04d3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:11.603433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:11.611832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 141/286] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/users/542544598a2d4dde8e303b1618aa04d3 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:11.613739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.630945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:11.643714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:11.644627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:11.645477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:11.652145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:11.658647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.835199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99273199-1f51-4361-b164-9d9375d010cc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:11.872832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85088c55-99b8-4808-af0a-d445756128fa None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:11.897307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:11.898178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.898456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.898731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.900684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:11.902142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:11.907675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:11.911172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:11.936614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:11.937323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:11.937609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:11.937884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:11.938705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:11.939017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:11.940446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:11.957298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 147/289] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:11.964372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:12.069596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b9356-5fb8-4284-90f3-342cad6b2978 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:12.105020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:12.105886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:12.106164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:12.106434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] PATH_INFO: `/v3/users/eb3a3022fe2145e3b86713961af483bc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:12.108182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] RBAC: Authorizing `identity:get_user(user_id=eb3a3022fe2145e3b86713961af483bc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:12.109673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:12.113408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 148/290] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:11 2022] GET /identity/v3/users/eb3a3022fe2145e3b86713961af483bc => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:12.116185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17aafc-1746-40e1-84d4-3b0a3d119f2b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:12.118273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:12.183376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:12.184287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:12.184563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:12.184833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/542544598a2d4dde8e303b1618aa04d3/roles/320747637b1046cba6f9911c870ba2de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:12.186802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7cfd425fdc4e30976571d2f413bcae, user_id=542544598a2d4dde8e303b1618aa04d3, role_id=320747637b1046cba6f9911c870ba2de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:12.188748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:12.248912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3142462-06f5-4772-bbbc-a84493c05986 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:12.277583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 143/291] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:11 2022] PUT /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/users/542544598a2d4dde8e303b1618aa04d3/roles/320747637b1046cba6f9911c870ba2de => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:12.290228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:12.290885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:12.291160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:12.291429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:12.364324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:12.365729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:12.511848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 149/292] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:12.518228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:12.638753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef11af-ad02-40b1-b5f6-ad97e5e99899 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:12.673057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3288e4-5051-4958-a16d-138e91f4ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:12.674169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3288e4-5051-4958-a16d-138e91f4ae00 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:12.674637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3288e4-5051-4958-a16d-138e91f4ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:12.675063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3288e4-5051-4958-a16d-138e91f4ae00 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:12.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3288e4-5051-4958-a16d-138e91f4ae00 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:12.678180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3288e4-5051-4958-a16d-138e91f4ae00 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:12.680455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 144/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:12 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:12.686484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:12.870061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfcbe2-6d8d-4912-9aff-082ee881606e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:12.917724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:12.918309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:12.918583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:12.918854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:12.919711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=eb3a3022fe2145e3b86713961af483bc) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:12.920020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:12.921441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b92250-fea7-4218-9c37-cd158a977a7f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:12.932465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 150/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:12 2022] GET /identity/v3/role_assignments?user.id=eb3a3022fe2145e3b86713961af483bc&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=d283c28c6467425d80d17a4b6dda137b => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:13.256156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556f67e-e2fc-46bb-b553-2db58afa9399 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.257179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556f67e-e2fc-46bb-b553-2db58afa9399 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.257674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556f67e-e2fc-46bb-b553-2db58afa9399 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.259657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 145/295] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:13.265201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdc99a-33ea-4b1b-8256-4e4c97125ff6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.266623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdc99a-33ea-4b1b-8256-4e4c97125ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.267142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdc99a-33ea-4b1b-8256-4e4c97125ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.287317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5dbdc99a-33ea-4b1b-8256-4e4c97125ff6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:13.288870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5dbdc99a-33ea-4b1b-8256-4e4c97125ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:13.289173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cded4a-92db-4e88-8d40-dd4fee844090 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.289458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cded4a-92db-4e88-8d40-dd4fee844090 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.289733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cded4a-92db-4e88-8d40-dd4fee844090 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.291388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 146/296] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:13.296087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.296374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.296688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.319116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:13.320419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:13.389479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 151/297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:13.416060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b48df-3ba7-4d63-b697-a1cd20238a65 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.416348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b48df-3ba7-4d63-b697-a1cd20238a65 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.416631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b48df-3ba7-4d63-b697-a1cd20238a65 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.420459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 147/299] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:13.420587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 152/299] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:13.421313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.423815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.424102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.424378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.445340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:13.446538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:13.524369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 153/300] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:13.525162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.542696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd5e73-38aa-4a6d-baf0-9049b35f7b6d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:13.575363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:13.576171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.576449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.576727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.586849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:13.595006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:13.595922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:13.596735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:13.601045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 148/301] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:13.601894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.624460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923ac1e-f674-4e95-9637-44b8e1ea32fa None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:13.661914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:13.662978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.663273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.663548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.674618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:13.682384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:13.689806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 154/302] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:13.690624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.702757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f3e3c-edcf-4b39-9120-f8313622fe69 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:13.743567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:13.744390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.744831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.745105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.746587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:13.748065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:13.751652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 149/303] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:13.751652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.793603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca0d32-6f83-4fc1-bf5f-84786013db83 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:13.826390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:13.827047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.827329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.827621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.828417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:13.828721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:13.830103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:13.839644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 155/304] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:13.839644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.854359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2594129-9f42-4567-b3d9-5bfc7445b2dd None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:13.891405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:13.892220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.892503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.892779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.893524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:13.893830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:13.895187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:13.903202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 150/305] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:13.904196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:13.942390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f055-ed7d-4ce2-99d8-f839bb5c0906 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:13.978545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:13.979223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:13.979508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:13.979826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] PATH_INFO: `/v3/groups` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:13.980518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:13.981960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:14.004067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4832f6-0d49-4c26-b2d7-6b027e85ee28 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:14.036022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:14.036884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:14.037160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:14.037428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] PATH_INFO: `/v3/users/05e6f212f4e0420ab6ece142950f5ce0` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:14.038592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] RBAC: Authorizing `identity:get_user(user_id=05e6f212f4e0420ab6ece142950f5ce0)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:14.040057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:14.049013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 151/306] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:13 2022] GET /identity/v3/users/05e6f212f4e0420ab6ece142950f5ce0 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:14.049013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:14.089180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 156/307] 10.222.0.23 () {60 vars in 1134 bytes} [Tue May 3 22:28:13 2022] POST /identity/v3/groups => generated 229 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:14.090092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:14.159009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c7ddc-6283-4066-8729-cf674be5f301 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:14.195156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:14.196236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:14.196630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:14.197000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] PATH_INFO: `/v3/users/fc1d25de49ec481e868ec1bf4b76367d` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:14.209148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c40a64-845d-40a0-b30e-ead455ffaea1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:14.212689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] RBAC: Authorizing `identity:get_user(user_id=fc1d25de49ec481e868ec1bf4b76367d)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:14.214174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:14.215967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 152/308] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:14 2022] GET /identity/v3/users/fc1d25de49ec481e868ec1bf4b76367d => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:14.222268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:14.251327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef882ee-ed7a-487b-a28c-95995404b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:14.252602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef882ee-ed7a-487b-a28c-95995404b248 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:14.252881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef882ee-ed7a-487b-a28c-95995404b248 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:14.253159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef882ee-ed7a-487b-a28c-95995404b248 None admin] PATH_INFO: `/v3/system/users/05e6f212f4e0420ab6ece142950f5ce0/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:14.255736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef882ee-ed7a-487b-a28c-95995404b248 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=05e6f212f4e0420ab6ece142950f5ce0, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:14.257234 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef882ee-ed7a-487b-a28c-95995404b248 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:14.333339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c265-7f46-407c-bad0-c5e4a25bf66b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:14.366232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:14.366890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:14.367167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:14.367435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:14.369479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] RBAC: Adding query filter params (role.id=320747637b1046cba6f9911c870ba2de, user.id=fc1d25de49ec481e868ec1bf4b76367d, scope.system=all) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:14.369479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:14.370026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c425-5dd4-4aeb-af9a-ab7b5b145ca5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:14.375767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 153/309] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 22:28:14 2022] GET /identity/v3/role_assignments?user.id=fc1d25de49ec481e868ec1bf4b76367d&scope.system=all&role.id=320747637b1046cba6f9911c870ba2de => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:14.407636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 157/310] 10.222.0.23 () {58 vars in 1334 bytes} [Tue May 3 22:28:14 2022] PUT /identity/v3/system/users/05e6f212f4e0420ab6ece142950f5ce0/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:15.010368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec1cb8-a424-49ba-9636-301f16d1b1b1 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:15.010661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec1cb8-a424-49ba-9636-301f16d1b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:15.010946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec1cb8-a424-49ba-9636-301f16d1b1b1 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:15.012597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 154/311] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:15.018147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:15.018439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:15.018722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:15.035560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:15.036769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:15.102414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 158/312] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:15.125737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec1cb8-a424-49ba-9636-301f16d1b1b1 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:15.227454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec1cb8-a424-49ba-9636-301f16d1b1b1 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:15.264724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:15.265639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:15.265915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:15.266182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:15.278137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:15.286525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:15.287404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:15.288213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 155/313] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:15.297262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:15.400657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a02106-edf1-4b1b-bbcf-3afb2b6e9a0a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:15.434551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:15.435252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:15.435486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:15.435790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:15.436528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:15.436826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:15.438247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:15.447088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 159/314] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:15.452985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:15.558813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fc74-9f48-44b6-b17b-d246bb5623df None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:15.595312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:15.596266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:15.596550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:15.596869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] PATH_INFO: `/v3/users/542544598a2d4dde8e303b1618aa04d3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:15.598084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] RBAC: Authorizing `identity:get_user(user_id=542544598a2d4dde8e303b1618aa04d3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:15.599545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:15.601570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 156/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:15 2022] GET /identity/v3/users/542544598a2d4dde8e303b1618aa04d3 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:15.607010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:15.708254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f598816-8773-4b8b-9bd9-c2b37fa8ca66 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:15.748703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:15.749739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:15.750707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:15.751182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:15.826128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:15.827508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:15.928476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 160/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:15.934105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:16.036968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee30e2-ab0f-46d8-9044-fa818848cc4e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:16.071281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eb73b-66e5-4675-bf0b-32fec854d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:16.072182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eb73b-66e5-4675-bf0b-32fec854d363 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.072516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eb73b-66e5-4675-bf0b-32fec854d363 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.072848 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eb73b-66e5-4675-bf0b-32fec854d363 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.074097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eb73b-66e5-4675-bf0b-32fec854d363 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:16.075547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eb73b-66e5-4675-bf0b-32fec854d363 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:16.077634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 157/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:15 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:16.083356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:16.184750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add555-c3ce-4db7-a819-1ac3ab32d1de None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:16.220587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:16.221272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.221555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.221833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.222693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] RBAC: Adding query filter params (role.id=320747637b1046cba6f9911c870ba2de, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae, user.id=542544598a2d4dde8e303b1618aa04d3) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:16.223008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:16.224661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a6bc8-0d8f-4b04-a3f1-f362fb990b04 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:16.236042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 161/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:16 2022] GET /identity/v3/role_assignments?user.id=542544598a2d4dde8e303b1618aa04d3&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=320747637b1046cba6f9911c870ba2de => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:16.411748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991d53-9164-485a-b932-a098c8b17590 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.412125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991d53-9164-485a-b932-a098c8b17590 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.412301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991d53-9164-485a-b932-a098c8b17590 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.413673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 158/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:16.418969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.419257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.419530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.437922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:16.439100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:16.507385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 162/320] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:16.530644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991d53-9164-485a-b932-a098c8b17590 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:16.630261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991d53-9164-485a-b932-a098c8b17590 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:16.662234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5643a2-697e-4a14-86d1-a49669f7f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:16.662937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5643a2-697e-4a14-86d1-a49669f7f296 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.663215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5643a2-697e-4a14-86d1-a49669f7f296 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.663484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5643a2-697e-4a14-86d1-a49669f7f296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.664658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5643a2-697e-4a14-86d1-a49669f7f296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:16.666103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5643a2-697e-4a14-86d1-a49669f7f296 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:16.667907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 159/321] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:16.673278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:16.706360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4234d-c50e-4ef7-b6a6-c91a7f0cd423 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.706649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4234d-c50e-4ef7-b6a6-c91a7f0cd423 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.706920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4234d-c50e-4ef7-b6a6-c91a7f0cd423 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.708324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 160/322] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:16.712885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30776a67-cd0d-4b25-8877-12a8183541f9 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.713172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30776a67-cd0d-4b25-8877-12a8183541f9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.713448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30776a67-cd0d-4b25-8877-12a8183541f9 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.714728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 161/323] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:16.715783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787a92b-068c-4154-b96a-5180a86e5452 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.716064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787a92b-068c-4154-b96a-5180a86e5452 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.716342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787a92b-068c-4154-b96a-5180a86e5452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.733299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6787a92b-068c-4154-b96a-5180a86e5452 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:16.734510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6787a92b-068c-4154-b96a-5180a86e5452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:16.771257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e4901-b643-4756-99c0-8db67f864af4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:16.797143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 162/324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:16.798397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.798683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.798957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.804794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:16.805735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:16.806018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:16.806302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] PATH_INFO: `/v3/groups` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:16.806979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:16.808435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:16.815298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:16.816545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:16.878464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 163/325] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:16.879254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:16.934899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 163/326] 10.222.0.23 () {60 vars in 1134 bytes} [Tue May 3 22:28:16 2022] POST /identity/v3/groups => generated 226 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:16.935672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:16.976172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee238-9162-4194-8c55-28ecc1ce14c4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.012912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.014005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.014288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.014563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.026343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:17.034275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:17.035216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:17.036517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 164/327] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:17.041549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:17.052643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab35ac-7b8d-4683-a07f-013df7dbde11 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.087728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.088532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.088822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.089095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.100158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:17.108010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:17.108981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:17.110602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 164/328] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:17.115523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:17.151364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5f7a-6540-44a4-8f1f-3ccd4f49c11b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.190037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.190633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.190915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.191195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.192009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:17.192319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:17.193711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:17.205385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 165/329] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:17.209587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:17.229359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e54da-b580-45a8-b01f-9d83ef6b1da1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.265223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.265987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.266268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.266542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.267384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:17.267731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:17.269189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:17.280169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 165/330] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:17.285878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:17.321906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad403d3-4b71-4709-8d6d-8893b230c9b6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.360628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.360869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.361021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.361439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] PATH_INFO: `/v3/users/fc1d25de49ec481e868ec1bf4b76367d` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.362516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] RBAC: Authorizing `identity:get_user(user_id=fc1d25de49ec481e868ec1bf4b76367d)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:17.364016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:17.366058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 166/331] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:17 2022] GET /identity/v3/users/fc1d25de49ec481e868ec1bf4b76367d => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:17.373477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:17.413336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955077b5-b3ae-443d-8d98-0527a12abf89 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.460548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.462179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.462605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.463074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] PATH_INFO: `/v3/users/05e6f212f4e0420ab6ece142950f5ce0` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.464518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] RBAC: Authorizing `identity:get_user(user_id=05e6f212f4e0420ab6ece142950f5ce0)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:17.466148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:17.468309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 166/332] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:17 2022] GET /identity/v3/users/05e6f212f4e0420ab6ece142950f5ce0 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:17.474206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:17.487625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881b61-eb9b-444d-ad92-5258a800df0b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.520528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3949084-c415-4ba5-8893-dab616b29a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.521394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949084-c415-4ba5-8893-dab616b29a19 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.521664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949084-c415-4ba5-8893-dab616b29a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.521939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3949084-c415-4ba5-8893-dab616b29a19 None admin] PATH_INFO: `/v3/system/users/fc1d25de49ec481e868ec1bf4b76367d/roles/320747637b1046cba6f9911c870ba2de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.523465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3949084-c415-4ba5-8893-dab616b29a19 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fc1d25de49ec481e868ec1bf4b76367d, role_id=320747637b1046cba6f9911c870ba2de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:17.524851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3949084-c415-4ba5-8893-dab616b29a19 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:17.579565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df23e1-2381-44b3-8db6-5c13f6133e6d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:17.610926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 167/333] 10.222.0.23 () {58 vars in 1334 bytes} [Tue May 3 22:28:17 2022] PUT /identity/v3/system/users/fc1d25de49ec481e868ec1bf4b76367d/roles/320747637b1046cba6f9911c870ba2de => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:28:17.618183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:17.619193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:17.619706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:17.620148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:17.621176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] RBAC: Adding query filter params (role.id=d283c28c6467425d80d17a4b6dda137b, user.id=05e6f212f4e0420ab6ece142950f5ce0, scope.system=all) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:17.621667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:17.623417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58331b8b-9699-473b-82ae-941598a1f81d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:17.639510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 167/334] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 22:28:17 2022] GET /identity/v3/role_assignments?user.id=05e6f212f4e0420ab6ece142950f5ce0&scope.system=all&role.id=d283c28c6467425d80d17a4b6dda137b => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:19.511494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744784d-0434-4d39-95e8-5ef2075f03a2 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:19.512434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744784d-0434-4d39-95e8-5ef2075f03a2 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:19.512886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744784d-0434-4d39-95e8-5ef2075f03a2 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:19.515006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 168/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:19.520222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:19.520636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:19.520778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:19.542736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:19.543974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:19.638800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 168/336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:19.674091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744784d-0434-4d39-95e8-5ef2075f03a2 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:19.821345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744784d-0434-4d39-95e8-5ef2075f03a2 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:19.863018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:19.864168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:19.864630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:19.865081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:19.880882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:19.889069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:19.889950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:19.890868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:19.898104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 169/337] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:19.908779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:20.035956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8343-3c0c-4872-ba5e-719c996e1b04 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:20.075133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:20.075759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.076045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.076324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.077089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:20.077396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:20.079351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c091de-f206-4b16-bc6c-0936d988ee34 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:20.088360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 169/338] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:20.094499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:20.242129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cf29-c52b-4671-80e3-d5ea02d67681 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:20.283227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:20.283909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.284206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.284454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.350460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb429b4-c017-4408-85cd-e2f86143eb2e None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.350801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb429b4-c017-4408-85cd-e2f86143eb2e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.351090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb429b4-c017-4408-85cd-e2f86143eb2e None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.352748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 170/339] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:20.362029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.362317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.362597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.393271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:20.394804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:20.395137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:20.396637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:20.492218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 171/340] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:20.535716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:20.570437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 170/341] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:20.576399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:20.686739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c340a1b-57a2-4dcd-af0b-8935a1896158 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:20.715682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745184fd-97b1-427e-8001-c47263f9ac2a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:20.734679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:20.735884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.736367 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.736838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.756767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:20.763666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:20.763666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.763666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.763666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.764009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:20.765976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:20.770569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:20.771472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 03 22:28:20.772299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:20.772899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 171/342] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:20 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:20.773449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:20.775151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 172/343] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:20.780930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:20.906124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb577-11d3-41e6-92e4-cc584e3fb3a7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:20.944155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:20.944747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.945026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.945300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.946049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:20.946351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:20.948942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c61b9-40c2-4f03-a92c-d16ea39d8029 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:20.957226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 173/344] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:20.958526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb21cf9-3b7b-4707-a16d-532983d1edf3 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.958860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb21cf9-3b7b-4707-a16d-532983d1edf3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.959077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb21cf9-3b7b-4707-a16d-532983d1edf3 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.961852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e23476-8cd9-4c44-9c36-d5783f7f07ae None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:20.965051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 174/345] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:20.966125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87409f90-00b7-4eb2-bee0-f285f9af963a None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.966412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87409f90-00b7-4eb2-bee0-f285f9af963a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.966691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87409f90-00b7-4eb2-bee0-f285f9af963a None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:20.973509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 175/346] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:20.975009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a64f6-82dd-47fc-9f95-df02f89c8b2c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:20.975009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a64f6-82dd-47fc-9f95-df02f89c8b2c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:20.975287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a64f6-82dd-47fc-9f95-df02f89c8b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.000614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.001953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.002410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.002885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.003058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2c3a64f6-82dd-47fc-9f95-df02f89c8b2c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:21.006508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2c3a64f6-82dd-47fc-9f95-df02f89c8b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:21.010593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:21.012337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:21.014774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 172/347] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:20 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:21.015828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.074315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 176/348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:21.075650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.075924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.076199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.093218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:21.094462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:21.129701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a652cd-2860-4823-a602-400d5727fedc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.163130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 177/349] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:21.164015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.166242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.167418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.167979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.168461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] PATH_INFO: `/v3/users/fc1d25de49ec481e868ec1bf4b76367d` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.169887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] RBAC: Authorizing `identity:get_user(user_id=fc1d25de49ec481e868ec1bf4b76367d)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:21.172898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:21.175736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 173/350] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/users/fc1d25de49ec481e868ec1bf4b76367d => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:21.176745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.293166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cac0b-657f-444d-b206-4c07b3998694 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.296551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7311da7-9a19-492a-b2e3-f3347b493e41 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.332891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.334059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.334641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.335119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.337883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.338832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.339113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.339384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.340257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=988e727f74e7410c973f04b479be26de) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:21.340593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:21.342428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:21.348718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:21.350297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 178/351] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=d283c28c6467425d80d17a4b6dda137b => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:21.351123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:21.357511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:21.358499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:21.362063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:21.366536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 174/352] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:21.368330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.526445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4742a-e3a7-4899-873b-64df4f01701a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.528010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716778df-e444-4e10-8e27-7b32ddc73235 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.567184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.567940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.568219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.568495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.573576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.574453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.574687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.575016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.575926 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] RBAC: Adding query filter params (role.id=320747637b1046cba6f9911c870ba2de, user.id=fc1d25de49ec481e868ec1bf4b76367d, scope.system=all) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:21.576238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:21.577675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:21.580055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:21.589021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:21.589938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:21.590742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:21.591863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 179/354] 10.222.0.23 () {56 vars in 1308 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/role_assignments?user.id=fc1d25de49ec481e868ec1bf4b76367d&scope.system=all&role.id=320747637b1046cba6f9911c870ba2de => generated 510 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:21.593038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.594510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 175/354] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:21.596939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.704050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec21b4-9ba8-44cc-956b-322e22a61edf None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.726039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db847c18-34b3-494d-9b80-c4c28f955201 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.742207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.742890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.743165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.743435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.744237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:21.744539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:21.745932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:21.759663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 176/355] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:21.761512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.761722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.762419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.762703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.762980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:21.764134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:21.764447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:21.765897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:21.775373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 180/356] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:21.780601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:21.901920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240c574-6102-470c-a7d9-9aeb1c7709be None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:21.942923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602dbbc-4f84-4cf2-8557-e19695979428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:21.943589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602dbbc-4f84-4cf2-8557-e19695979428 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:21.943980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602dbbc-4f84-4cf2-8557-e19695979428 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:21.944259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602dbbc-4f84-4cf2-8557-e19695979428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.001054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36374e1-ff2f-4471-87d1-2bce8aed9c9b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.031731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602dbbc-4f84-4cf2-8557-e19695979428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.033262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602dbbc-4f84-4cf2-8557-e19695979428 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.076930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.077600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.077917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.078195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.138213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 181/357] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:22.139941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13608e2-6830-4fe6-951a-938fff44b658 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.140271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13608e2-6830-4fe6-951a-938fff44b658 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.140539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13608e2-6830-4fe6-951a-938fff44b658 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.142049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 182/358] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:22.143468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13608e2-6830-4fe6-951a-938fff44b658 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.195710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.197095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.283106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13608e2-6830-4fe6-951a-938fff44b658 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.320624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89159f-4f39-4513-afce-f96375c345eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.321823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89159f-4f39-4513-afce-f96375c345eb None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.322304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89159f-4f39-4513-afce-f96375c345eb None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.322789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89159f-4f39-4513-afce-f96375c345eb None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.324207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89159f-4f39-4513-afce-f96375c345eb None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.325834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89159f-4f39-4513-afce-f96375c345eb None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.328299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 183/359] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:22.329784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96c0a-8a20-4e10-8b56-b8ed6b8980f6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.330279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96c0a-8a20-4e10-8b56-b8ed6b8980f6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.330758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae96c0a-8a20-4e10-8b56-b8ed6b8980f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.341748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 177/360] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:22.342861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.349971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9ae96c0a-8a20-4e10-8b56-b8ed6b8980f6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:22.351164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9ae96c0a-8a20-4e10-8b56-b8ed6b8980f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:22.429017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 184/361] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:22.431950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587e05-09a7-4d82-ad81-b727bc9785eb None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.432762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587e05-09a7-4d82-ad81-b727bc9785eb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.433237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587e05-09a7-4d82-ad81-b727bc9785eb None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.435577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 185/362] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:22.437240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587e05-09a7-4d82-ad81-b727bc9785eb None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.458964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a00f9-66ff-451a-92dd-8bb25724cf44 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.507509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05ac7d-4738-42db-9090-92c2c0abfb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.508804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ac7d-4738-42db-9090-92c2c0abfb9a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.509266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ac7d-4738-42db-9090-92c2c0abfb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.509545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ac7d-4738-42db-9090-92c2c0abfb9a None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.511183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05ac7d-4738-42db-9090-92c2c0abfb9a None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.512648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05ac7d-4738-42db-9090-92c2c0abfb9a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.514416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 178/363] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:22.516170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.516479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.516754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.534245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:22.535405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:22.559380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587e05-09a7-4d82-ad81-b727bc9785eb None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.596025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.597639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.598133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.598597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.600047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.601645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.603484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 186/364] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:22.604812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.606499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 179/365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:22.611642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.719411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be93b8-a4e9-4904-8d73-cbfcbc261d4e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.729841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db559e46-1353-4fd5-8713-9f84b036b936 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.754279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.755004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.755290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.755565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.756496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:22.756923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.758242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.766878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 180/366] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=d283c28c6467425d80d17a4b6dda137b => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:22.768535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.790646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.791512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.791893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.792510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.804833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:22.813420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:22.814392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:22.815553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 187/367] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:22.817911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:22.907949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62533905-6b01-45bb-ad97-6f74c370b827 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.944835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89df2a-cfc2-49cf-8292-be93bc8285c8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:22.953352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:22.954548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:22.954970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:22.955381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:22.957610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:22.959353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:22.962684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 181/368] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:22.963728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.005944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.006755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.007038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.007307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.019023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:23.027219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:23.028244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:23.029031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:23.029908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 188/369] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:23.030641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.095448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c048953-3146-4af0-abcb-05ab16a1ea20 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.134964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.136258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.136672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.137082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.138248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:23.138942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.139827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47571279-d87e-4e2d-980d-dacd49b7b13d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.140945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.152747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 182/370] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:23.154009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.176172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.176981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.177363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.177739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.178687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=988e727f74e7410c973f04b479be26de) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:23.179116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.180685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.189814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 189/371] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=01fa319c34404bab84538eca6b902bdb => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:23.190877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.266811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852b51f-32a2-4c9d-aa52-7d3583db811c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.296244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802bc43-bb2b-4308-9c46-db8a6cf59bed None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.333258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.334174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.334597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.335010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.344596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.345279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.346025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.346025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.346590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:23.346899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.348481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.369975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 183/372] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:23.377761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.412187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.413891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.520684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 190/373] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:23.526491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.589619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c94047-fdf6-46b5-a616-15cfb9b025fa None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.622940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.623582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.623886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.624160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.647836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65262799-387b-4a52-b70c-418dc8983030 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.698211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.700122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.700545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.701086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] PATH_INFO: `/v3/projects/479aaf8f5b564abd915b2557f4bef485` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.703556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] RBAC: Authorizing `identity:get_project(project_id=479aaf8f5b564abd915b2557f4bef485)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.705651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.712226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 191/374] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/projects/479aaf8f5b564abd915b2557f4bef485 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:23.712751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.714213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.737407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.840922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 184/375] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:23.847692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:23.907430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe812a-ccd7-4921-96b2-9a0fa06cdf99 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.948046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115006f1-c9a1-4f56-943e-a67ae98c55cb None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:23.949197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:23.950243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:23.950716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:23.951157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] PATH_INFO: `/v3/groups/52edad66f85d479b867514b80e90785a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:23.960152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] RBAC: Authorizing `identity:get_group(group_id=52edad66f85d479b867514b80e90785a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:23.961858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:23.964114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 192/376] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/groups/52edad66f85d479b867514b80e90785a => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:23.973780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:24.006269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.007144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.007424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.007722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.009004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:24.010551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:24.012822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 185/377] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:24.018888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:24.118292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41cdd7-f094-4603-857a-9f802bb70212 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:24.130680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431efff-362a-444c-b5a3-7ed5cb01be5f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:24.164180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.164846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.165121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.165394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.166233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] RBAC: Adding query filter params (group.id=52edad66f85d479b867514b80e90785a, role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=479aaf8f5b564abd915b2557f4bef485) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:24.166542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:24.168088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:24.173510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e23e8-93f4-4352-9cc8-a0b9e70637f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.174641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e23e8-93f4-4352-9cc8-a0b9e70637f8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.175154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 193/378] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:23 2022] GET /identity/v3/role_assignments?group.id=52edad66f85d479b867514b80e90785a&scope.project.id=479aaf8f5b564abd915b2557f4bef485&role.id=4c81f00224c04152b175b99a19a7b21c => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:24.175376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e23e8-93f4-4352-9cc8-a0b9e70637f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.175859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e23e8-93f4-4352-9cc8-a0b9e70637f8 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.177286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e23e8-93f4-4352-9cc8-a0b9e70637f8 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:24.178966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e23e8-93f4-4352-9cc8-a0b9e70637f8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:24.181461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 186/379] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:24 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:24.186997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:24.245418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6750-058e-4adf-aaa5-359ac0fbf1f8 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.246039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6750-058e-4adf-aaa5-359ac0fbf1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.246542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6750-058e-4adf-aaa5-359ac0fbf1f8 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.248239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 187/380] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:24.258494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.258818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.259061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.278321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:24.279548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:24.317737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523f0e-0f66-4686-aba7-6dd456e4ecd7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:24.354254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 188/381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:24.366219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.367435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.367935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.368462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.369575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:24.370092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:24.371798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:24.383648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:24.385716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 194/382] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:24 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=01fa319c34404bab84538eca6b902bdb => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:24.487910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f192a54-4ffa-40dc-b32e-e1356a31840e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:24.529310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.530127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.530410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.530689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.547021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:24.555002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:24.555903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:24.557261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 189/383] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:24.562506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:24.681990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ab6a2-a947-434f-bc12-fce9762b0559 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:24.723877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.724557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.724900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.725178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.725994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:24.726301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:24.727698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:24.739722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 195/384] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:24.745344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:24.865220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea4a8b-bc7b-4d02-afe3-9a20fb49e8ce None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:24.903329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:24.904265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:24.904549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:24.904826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:24.910786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:24.912362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:24.914330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 190/385] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:24 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:24.919811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:25.043894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e20bbb-c303-4fa8-8eb5-f85f52443eba None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:25.080210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005cd0a-a7ad-4abe-afa1-c6ea037c646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:25.081091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005cd0a-a7ad-4abe-afa1-c6ea037c646e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:25.081369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005cd0a-a7ad-4abe-afa1-c6ea037c646e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:25.081645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005cd0a-a7ad-4abe-afa1-c6ea037c646e None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:25.082849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005cd0a-a7ad-4abe-afa1-c6ea037c646e None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:25.084327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005cd0a-a7ad-4abe-afa1-c6ea037c646e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:25.086392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 196/386] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:24 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:25.092289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:25.199852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad86735-e750-4432-8d9f-a1473807f040 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:25.238772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8704f3-dc21-4134-922b-c716811358d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:25.239681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8704f3-dc21-4134-922b-c716811358d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:25.239971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8704f3-dc21-4134-922b-c716811358d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:25.240251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8704f3-dc21-4134-922b-c716811358d2 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de/groups/5ef61393787545ddb87cdacbdef964c6/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:25.242253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8704f3-dc21-4134-922b-c716811358d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=988e727f74e7410c973f04b479be26de, group_id=5ef61393787545ddb87cdacbdef964c6, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:25.243738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8704f3-dc21-4134-922b-c716811358d2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:25.341554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 191/387] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 22:28:25 2022] PUT /identity/v3/projects/988e727f74e7410c973f04b479be26de/groups/5ef61393787545ddb87cdacbdef964c6/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:28:25.813624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96df61-25b4-4d21-bb3d-d6906ee25aeb None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:25.814133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96df61-25b4-4d21-bb3d-d6906ee25aeb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:25.814207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96df61-25b4-4d21-bb3d-d6906ee25aeb None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:25.815832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 197/388] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:25.821678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:25.822102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:25.822320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:25.840787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:25.841975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:25.930103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 192/389] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:25.965162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96df61-25b4-4d21-bb3d-d6906ee25aeb None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.106548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96df61-25b4-4d21-bb3d-d6906ee25aeb None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:26.153425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:26.154240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.154604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.154861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.167186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:26.177027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:26.177996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:26.179255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 198/390] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:26.184899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.299190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9c6e9-d6fa-4f02-8c76-51bd4884077a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:26.339281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:26.339991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.340269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.340541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.341308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] RBAC: Adding query filter params (name=member) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:26.341613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:26.342987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542b673-758f-47c3-a022-0887bc27616e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:26.356455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 193/391] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:26.361743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.397898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ebaa-cefd-410d-829c-ecf2b8799168 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.398201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ebaa-cefd-410d-829c-ecf2b8799168 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.398466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ebaa-cefd-410d-829c-ecf2b8799168 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.400109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 194/392] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:26.405254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.405519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.405833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.432581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:26.433779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:26.502896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 195/393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:26.526288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.557745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbadc7-e7ec-4b68-af78-608538feff7a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:26.627168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3dc6ad-1cb5-4569-8cb1-6d3e8d0cd5cc None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:26.637711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:26.639160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.639660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.640131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.648404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:26.650370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:26.652679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 199/394] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:26 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:26.657868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.662239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:26.663060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.663342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.663634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.676029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:26.684398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:26.688227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:26.689045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 196/395] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:26.693109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.798550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87ad6-f93b-4eba-a945-70cda1a45ae5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:26.832580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:26.833237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.833521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.833801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.834561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:26.834942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:26.836308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:26.845303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 197/396] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:26.850725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.867196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dd5de-e41b-45b1-b5e8-5dab9f95778d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:26.925785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bdf48-8035-47b0-891d-6bf228514cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:26.927141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bdf48-8035-47b0-891d-6bf228514cee None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.927636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bdf48-8035-47b0-891d-6bf228514cee None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.928105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bdf48-8035-47b0-891d-6bf228514cee None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.929698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bdf48-8035-47b0-891d-6bf228514cee None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:26.931510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bdf48-8035-47b0-891d-6bf228514cee None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:26.934393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 200/397] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:26 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:26.936314 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3f33-84b0-4b6d-99b2-6b0a1b57401d None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:26.937849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3f33-84b0-4b6d-99b2-6b0a1b57401d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:26.938292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e3f33-84b0-4b6d-99b2-6b0a1b57401d None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:26.942352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 201/398] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:26.942483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e3f33-84b0-4b6d-99b2-6b0a1b57401d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:26.980600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91599e7-e85e-4419-b8eb-69d63fce74a1 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.027065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2723f3-a23f-4575-ae7e-ee6897468e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.028805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2723f3-a23f-4575-ae7e-ee6897468e45 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.029266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2723f3-a23f-4575-ae7e-ee6897468e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.029902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2723f3-a23f-4575-ae7e-ee6897468e45 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.031956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2723f3-a23f-4575-ae7e-ee6897468e45 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.033835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2723f3-a23f-4575-ae7e-ee6897468e45 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.036616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 198/399] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:26 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:27.038200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.039171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.043778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.068818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:27.071029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:27.088541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e3f33-84b0-4b6d-99b2-6b0a1b57401d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.131180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.132356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.132783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.133600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/groups/5ef61393787545ddb87cdacbdef964c6/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.136247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7cfd425fdc4e30976571d2f413bcae, group_id=5ef61393787545ddb87cdacbdef964c6, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.138708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.147833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 199/400] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:27.148742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:27.238154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 202/401] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 22:28:26 2022] PUT /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/groups/5ef61393787545ddb87cdacbdef964c6/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:27.239311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:27.292481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b9d0-9bd4-4a03-84d8-9b7ce807eee6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.355910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.357208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.357745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.358241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.360375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.362121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.368047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 200/402] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:27 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:27.373475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78044c3-d3ad-4ab1-a077-005fcc8bd60b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.374620 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:27.414931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.415766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.416044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.416315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.435766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:27.443532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:27.444543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:27.445352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:27.450834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 203/403] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:27.461619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:27.534226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7dfbb-54ef-4d76-bfc1-a45385948d6c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.570507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.571400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.571712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.571987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de/groups/5ef61393787545ddb87cdacbdef964c6/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.574647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] RBAC: Authorizing `identity:create_grant(project_id=988e727f74e7410c973f04b479be26de, group_id=5ef61393787545ddb87cdacbdef964c6, role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.576138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.577431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caf04e-5020-47dd-baf4-933a6277a363 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.612681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.613348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.613623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.613891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.614636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:27.614937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.616330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.629894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 204/404] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:27.631206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:27.729245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 201/405] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 22:28:27 2022] PUT /identity/v3/projects/988e727f74e7410c973f04b479be26de/groups/5ef61393787545ddb87cdacbdef964c6/roles/01fa319c34404bab84538eca6b902bdb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:27.734021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6ad2-b4d4-4b5a-8f4c-1287edc62c74 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.771228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.772149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.772424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.772697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] PATH_INFO: `/v3/groups/52edad66f85d479b867514b80e90785a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.774302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] RBAC: Authorizing `identity:get_group(group_id=52edad66f85d479b867514b80e90785a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.775772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.782626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 205/406] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:27 2022] GET /identity/v3/groups/52edad66f85d479b867514b80e90785a => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:27.784024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:27.917961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d2c90-fbc6-4851-aa14-ad0db9c87178 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:27.961208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273cb4-c9cb-4373-981e-5f031a756cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:27.962087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273cb4-c9cb-4373-981e-5f031a756cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:27.962364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273cb4-c9cb-4373-981e-5f031a756cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:27.962636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273cb4-c9cb-4373-981e-5f031a756cb1 None admin] PATH_INFO: `/v3/projects/479aaf8f5b564abd915b2557f4bef485` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:27.963938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273cb4-c9cb-4373-981e-5f031a756cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=479aaf8f5b564abd915b2557f4bef485)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:27.965415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273cb4-c9cb-4373-981e-5f031a756cb1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:27.977073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 202/407] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:27 2022] GET /identity/v3/projects/479aaf8f5b564abd915b2557f4bef485 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:27.978485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:28.087742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630abc1-6dc1-4a3e-90ce-3b81a1149c7e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:28.120894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:28.121778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.122053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.122322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] PATH_INFO: `/v3/projects/479aaf8f5b564abd915b2557f4bef485/groups/52edad66f85d479b867514b80e90785a/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.124301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=479aaf8f5b564abd915b2557f4bef485, group_id=52edad66f85d479b867514b80e90785a, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:28.126307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:28.161285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28963e-2573-40de-adbd-9bfa596f9525 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.161285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28963e-2573-40de-adbd-9bfa596f9525 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.161285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28963e-2573-40de-adbd-9bfa596f9525 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.162102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 203/408] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:28.167256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.167810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.168548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.185390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:28.186853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:28.242143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 206/409] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 22:28:27 2022] PUT /identity/v3/projects/479aaf8f5b564abd915b2557f4bef485/groups/52edad66f85d479b867514b80e90785a/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:28.272505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 204/410] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:28.307106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:28.434219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3712c-964f-401b-adbc-ae181513a2f3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:28.481614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb0710-09af-42fc-96dd-80030bb2cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:28.482747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0710-09af-42fc-96dd-80030bb2cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.483238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0710-09af-42fc-96dd-80030bb2cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb0710-09af-42fc-96dd-80030bb2cf14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.501037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb0710-09af-42fc-96dd-80030bb2cf14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-47cb0710-09af-42fc-96dd-80030bb2cf14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:28.509506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:28.510410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:28.511200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:28.511864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 207/411] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:28.517124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:28.619454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d6bde-88c7-4553-996b-27ba7a2c7c29 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:28.622380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96466cb3-396a-4622-b041-3943fe545333 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.622885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96466cb3-396a-4622-b041-3943fe545333 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.623411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96466cb3-396a-4622-b041-3943fe545333 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.625851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 208/412] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:28.633813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.634111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.634394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.658602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:28.659922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:28.667078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:28.667791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.668074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.668354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.669119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:28.669425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:28.670814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:28.687903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 205/413] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:28.693289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:28.757922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 209/414] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:28.794319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e043ff0-6665-4c17-80f4-2bf7a0761df2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:28.799903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:28.837187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:28.838425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.838904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.839399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.843931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:28.845776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:28.847630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 206/415] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:28 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:28.852977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:28.912339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca2ad-c517-4bfd-9db2-836267dd1b86 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:28.950172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:28.950934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:28.951212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:28.951483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:28.978789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:28.990601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:28.991525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:28.992346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:29.000885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 210/416] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:29.002119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:29.055166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27c252-6c1a-4021-bb38-1d8f3c6cd9d7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:29.113795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc986a-00fc-49a2-a7e4-51fc5bde9809 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:29.149312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:29.150179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.150462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.150741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.152399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:29.154435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:29.155140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.155428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.155789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.157140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] RBAC: Adding query filter params (name=member) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:29.157513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:29.158872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:29.163780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:29.165944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 207/417] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:28 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:29.167953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 211/418] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:29.171621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:29.176547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:29.276885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062765e-807c-435a-b3e4-02b2a398bdea None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:29.316062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:29.316719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.316998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.317272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.378653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54577a-8729-4b1b-8caa-abcf87e0e3e6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:29.431901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:29.432789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.433071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.433357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/groups/5ef61393787545ddb87cdacbdef964c6/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.438150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a7cfd425fdc4e30976571d2f413bcae, group_id=5ef61393787545ddb87cdacbdef964c6, role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:29.439591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:29.451103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:29.453410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:29.529320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 208/419] 10.222.0.23 () {58 vars in 1442 bytes} [Tue May 3 22:28:29 2022] PUT /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae/groups/5ef61393787545ddb87cdacbdef964c6/roles/01fa319c34404bab84538eca6b902bdb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:28:29.563316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 212/420] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:29.568860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:29.697022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc3782-1f30-484e-b0ab-43fb975a6fc4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:29.748465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:29.749360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.750192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.750467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.751874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:29.753401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:29.755577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 209/421] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:29 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:29.761032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:29.899108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123559fa-4455-4bdd-9a15-0b9c916eed00 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:29.938212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9445b-0861-496f-8abe-73f5a4ed0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:29.939467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9445b-0861-496f-8abe-73f5a4ed0f63 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.939966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9445b-0861-496f-8abe-73f5a4ed0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.940431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9445b-0861-496f-8abe-73f5a4ed0f63 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.941826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9445b-0861-496f-8abe-73f5a4ed0f63 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:29.943478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9445b-0861-496f-8abe-73f5a4ed0f63 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:29.945756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 213/422] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:29 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:29.951234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:29.958538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2417-2f6c-4e67-8928-12a16d51b852 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.958538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2417-2f6c-4e67-8928-12a16d51b852 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.958538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae2417-2f6c-4e67-8928-12a16d51b852 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.958989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 214/423] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:29.964033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:29.964319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:29.964598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:29.981555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:29.982732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:30.092170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 215/424] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:30.111963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16c84d-05ef-45d3-bd06-c5f14819faf6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:30.115643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:30.169283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:30.170195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:30.170642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:30.171063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:30.172657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=988e727f74e7410c973f04b479be26de) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:30.173130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:30.174606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:30.191638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 210/425] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:29 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=d283c28c6467425d80d17a4b6dda137b => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:30.259830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d9d1f-3a72-4408-b26f-f4c7fa988450 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:30.303497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:30.304683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:30.305163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:30.305677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:30.316806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:30.325104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:30.326087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 03 22:28:30.326885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:30.329473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 216/426] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:30.335369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:30.475839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abf71b-1fb6-4e29-ab02-3b078c97099a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:30.509778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:30.510805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:30.511289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:30.511827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:30.512778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:30.513284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:30.515680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfbb3a-9b20-4821-83ee-1874398127c0 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:30.524611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 211/427] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:28:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:30.530269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:30.639527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff627cd-ca11-415a-b62d-4bb9bbe03434 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:30.681907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:30.682939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:30.683440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:30.683958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:30.764169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:30.766619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:30.811856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950babe9-6557-4ed1-a274-6387d1f0d806 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:30.813039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950babe9-6557-4ed1-a274-6387d1f0d806 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:30.813540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950babe9-6557-4ed1-a274-6387d1f0d806 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:30.815401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 212/428] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:30.821660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:30.821943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:30.822223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:30.854361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:30.855977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:30.896146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 217/429] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:30.901195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:30.942487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 213/430] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:30.966896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.013345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427168-e5f4-4cf1-b1bf-7a3d56d035d4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.052278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1b1d2-ff3a-492f-864f-4c5c7fe12a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.053072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b1d2-ff3a-492f-864f-4c5c7fe12a93 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.053359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b1d2-ff3a-492f-864f-4c5c7fe12a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.053977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1b1d2-ff3a-492f-864f-4c5c7fe12a93 None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.055283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1b1d2-ff3a-492f-864f-4c5c7fe12a93 None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.056789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1b1d2-ff3a-492f-864f-4c5c7fe12a93 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.058781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 218/431] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:30 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:31.060177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58d8dd-8611-4d56-ac49-c0e1678e5b1c None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.060460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58d8dd-8611-4d56-ac49-c0e1678e5b1c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.060731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58d8dd-8611-4d56-ac49-c0e1678e5b1c None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.062271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 219/432] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:31.065612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58d8dd-8611-4d56-ac49-c0e1678e5b1c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.081843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f393acf-31c3-49f3-a337-e1974d0a6c04 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.116048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931ca7b-8f2b-437e-8cfd-4f9bd4a7649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.116853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931ca7b-8f2b-437e-8cfd-4f9bd4a7649d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.117133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931ca7b-8f2b-437e-8cfd-4f9bd4a7649d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.117404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931ca7b-8f2b-437e-8cfd-4f9bd4a7649d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.127350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931ca7b-8f2b-437e-8cfd-4f9bd4a7649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7931ca7b-8f2b-437e-8cfd-4f9bd4a7649d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:31.135282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:31.136246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:31.137070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 214/433] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:31.137821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.138397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.138397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.156287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:31.157476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:31.177069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58d8dd-8611-4d56-ac49-c0e1678e5b1c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.212773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.213616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.213891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.214155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.215306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.216752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.218853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 220/434] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:31.219596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.232490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 215/435] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:31.233661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.324638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00cd35-918a-4e6f-a77c-b4df1e2fa747 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.334677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf9d3-0b9b-46ff-a025-b120c029f53b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.359982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.360634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.360909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.361181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.361912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:31.362210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.363554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.367667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.368319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.368604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.368882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.369712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=d283c28c6467425d80d17a4b6dda137b, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:31.370025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.375865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 221/436] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:31.375998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.376074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.377468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 216/437] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=d283c28c6467425d80d17a4b6dda137b => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:31.378168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.507796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d958c-247c-46aa-a766-3599f21e2756 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.518895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c409fb-1e64-4fc7-9cd3-3ce4b38d028c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.546547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.547360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.547671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.547951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.562372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:31.565670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.566318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.566593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.566862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:31.571850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:31.572763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:31.573569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 222/438] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:31.579637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.659281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.660833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.698445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587703e7-4800-4fa0-b1f4-b9cb477812a0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.731947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.732622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.732902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.733178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.733983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:31.734288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.735692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.748868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 223/439] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:31.750074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.761148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 217/440] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:31.761922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.850329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45196a23-bdd8-4bf9-83df-6db78e5a9ee1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.857930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554b32-7022-4d78-97c2-91ffbfd18f77 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:31.883548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.884226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.884518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.884801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.892004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:31.892859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:31.893135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:31.893407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] PATH_INFO: `/v3/projects/988e727f74e7410c973f04b479be26de` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:31.894960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] RBAC: Authorizing `identity:get_project(project_id=988e727f74e7410c973f04b479be26de)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.896412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:31.898426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 218/441] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/projects/988e727f74e7410c973f04b479be26de => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:31.903435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:31.952586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:31.954558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.007427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1445e-c521-4ae7-ae0f-71042fb4c381 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.041487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.042338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.042616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.042886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.044082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.045527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.047876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 219/442] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:32.053210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 224/443] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:28:32.053940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.057512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.153952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b2c3d-7a57-4d54-8f45-7ceba82a5841 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.154474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7db96-2825-4f09-9adf-c1ffd60e1bf4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.188466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.189140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.189410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.189680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.190505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=988e727f74e7410c973f04b479be26de) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:32.190814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.191341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.192220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.192314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68184f66-053e-4eee-8fff-2dca6623ce22 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.192501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.192773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] PATH_INFO: `/v3/projects/479aaf8f5b564abd915b2557f4bef485` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.193948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=479aaf8f5b564abd915b2557f4bef485)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.195365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.197229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 225/444] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/projects/479aaf8f5b564abd915b2557f4bef485 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:32.207679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 220/445] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=988e727f74e7410c973f04b479be26de&role.id=01fa319c34404bab84538eca6b902bdb => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:32.207915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.305837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ed6bf-13c0-4770-9335-3861870e5bd3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.320668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462bf71-f7bd-465f-afe7-e6b298148c75 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.320984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462bf71-f7bd-465f-afe7-e6b298148c75 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.321227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462bf71-f7bd-465f-afe7-e6b298148c75 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.322952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 221/446] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:32.328207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.328486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.328769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.342259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.343107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.343420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.343725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] PATH_INFO: `/v3/groups/52edad66f85d479b867514b80e90785a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.344935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] RBAC: Authorizing `identity:get_group(group_id=52edad66f85d479b867514b80e90785a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.345525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:32.346400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.346734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:32.352957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 226/447] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/groups/52edad66f85d479b867514b80e90785a => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:32.354724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.430685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 222/448] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:32.452929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.468963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15f0e7-dcbc-41db-83a1-a3ee31fb8084 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.505459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.506106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.506391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.506667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.507494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] RBAC: Adding query filter params (group.id=52edad66f85d479b867514b80e90785a, role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=479aaf8f5b564abd915b2557f4bef485) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:32.507903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.509448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.516786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 227/449] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/role_assignments?group.id=52edad66f85d479b867514b80e90785a&scope.project.id=479aaf8f5b564abd915b2557f4bef485&role.id=4c81f00224c04152b175b99a19a7b21c => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:32.565825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdac80-3324-4f72-98db-27279558f458 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.604100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.604922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.605201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.605471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.617510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:32.625852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:32.626881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:32.627792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 223/450] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:32.633321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.744836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3225-741a-4e3a-a1fd-c44b5b3c80f2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.779092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.779808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.780093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.780369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.781686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:32.781993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.783381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:32.791431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 228/451] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:32.797205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:32.891000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc3fd-1e1a-4e2e-a483-d11156a2b9be None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:32.922269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:32.922899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:32.923184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:32.923464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:32.986222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:32.987725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:33.082464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 224/452] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:33.088021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:33.182025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc7ba6-29b3-4ca6-ad9c-02470e6eef6d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:33.213693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:33.214531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:33.214813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:33.215089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] PATH_INFO: `/v3/projects/2a7cfd425fdc4e30976571d2f413bcae` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:33.216279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] RBAC: Authorizing `identity:get_project(project_id=2a7cfd425fdc4e30976571d2f413bcae)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:33.217725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:33.219408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 229/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:28:33 2022] GET /identity/v3/projects/2a7cfd425fdc4e30976571d2f413bcae => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:33.224760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:33.316337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c12db-8d2f-4f10-9219-ccb89f4f8278 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:33.347592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acd16c-b441-476f-91cb-5adcf5681d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:33.348447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd16c-b441-476f-91cb-5adcf5681d3a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:33.348727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd16c-b441-476f-91cb-5adcf5681d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:33.348998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acd16c-b441-476f-91cb-5adcf5681d3a None admin] PATH_INFO: `/v3/groups/5ef61393787545ddb87cdacbdef964c6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:33.350141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acd16c-b441-476f-91cb-5adcf5681d3a None admin] RBAC: Authorizing `identity:get_group(group_id=5ef61393787545ddb87cdacbdef964c6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:33.351579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acd16c-b441-476f-91cb-5adcf5681d3a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:33.353197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 225/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue May 3 22:28:33 2022] GET /identity/v3/groups/5ef61393787545ddb87cdacbdef964c6 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:33.358947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:33.455304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00cc41-8427-4071-b66f-8b457160370a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:33.486238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:33.486871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:33.487152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:33.487428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:33.488297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] RBAC: Adding query filter params (group.id=5ef61393787545ddb87cdacbdef964c6, role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=2a7cfd425fdc4e30976571d2f413bcae) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:33.488599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:33.490032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097c090-4b99-429a-ae45-931046d74083 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:33.495811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 230/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue May 3 22:28:33 2022] GET /identity/v3/role_assignments?group.id=5ef61393787545ddb87cdacbdef964c6&scope.project.id=2a7cfd425fdc4e30976571d2f413bcae&role.id=01fa319c34404bab84538eca6b902bdb => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:36.510689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16de0-45b5-426b-8fdd-6d905e0b8fe0 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.511765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16de0-45b5-426b-8fdd-6d905e0b8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.512266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e16de0-45b5-426b-8fdd-6d905e0b8fe0 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.514343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 226/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:36.520536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f476-eebf-4c13-bde8-eca65a7507aa None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.521372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f476-eebf-4c13-bde8-eca65a7507aa None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.521876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f476-eebf-4c13-bde8-eca65a7507aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.538881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9af4f476-eebf-4c13-bde8-eca65a7507aa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:36.540428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9af4f476-eebf-4c13-bde8-eca65a7507aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:36.609230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 231/457] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:36.633781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16de0-45b5-426b-8fdd-6d905e0b8fe0 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:36.667596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5cae-4f60-4476-9293-8501e962aeb3 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.667941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5cae-4f60-4476-9293-8501e962aeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.668175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e5cae-4f60-4476-9293-8501e962aeb3 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.670385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 232/458] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:36.678641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f0ba3-c51e-4779-afd3-a5878fd4a146 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.680450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f0ba3-c51e-4779-afd3-a5878fd4a146 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.680450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f0ba3-c51e-4779-afd3-a5878fd4a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.712038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-dd8f0ba3-c51e-4779-afd3-a5878fd4a146 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:36.713557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-dd8f0ba3-c51e-4779-afd3-a5878fd4a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:36.765970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e16de0-45b5-426b-8fdd-6d905e0b8fe0 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:36.805567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:36.807285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.807644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.807931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.819821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:36.821283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:36.841553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:36.842475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:36.844339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:36.844339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:36.844339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:36.844339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:36.844339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 227/459] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:36.849509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:36.889494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 233/460] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:36.891407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aaaf2-1e8e-47a7-ad7d-0d2a29c89e20 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.891722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aaaf2-1e8e-47a7-ad7d-0d2a29c89e20 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.892000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925aaaf2-1e8e-47a7-ad7d-0d2a29c89e20 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.893498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 234/461] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:36.909067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.909359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.909622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.932901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:36.934452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:36.954513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d7052-05f3-45ac-b934-938428c045f9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:36.993459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:36.994651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:36.995142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:36.995922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:36.996865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:36.997387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.000282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220bb74d-86c9-4d86-ac9c-19447168b9c3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.019473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 235/462] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:37.019473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.019746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 228/463] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:37.019746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953a6d8-c8d9-4145-b945-25263300ab56 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.019746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953a6d8-c8d9-4145-b945-25263300ab56 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.019746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953a6d8-c8d9-4145-b945-25263300ab56 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.019746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 229/464] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:37.021448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953a6d8-c8d9-4145-b945-25263300ab56 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.120461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467413da-c1de-43d2-8a5f-baca721f7af3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.136210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953a6d8-c8d9-4145-b945-25263300ab56 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.154109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.154898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.155180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.155460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.165334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.166792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.168668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.169336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.169616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.169895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.170600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.172409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-8fe54166-02d7-4b33-ac87-fe820329972a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:37.184982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:37.186052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:37.187466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:37.187466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:37.187466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:37.187466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:37.187466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 236/465] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:37.187910 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.188188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.188455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.205028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:37.206197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:37.269432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 237/466] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:37.270330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.318054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 230/467] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:37 2022] POST /identity/v3/users => generated 246 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:37.318054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.399447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67677071-e1e0-4c17-99c2-c14b350534be None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.429049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ad39d-2b90-4d3a-8d67-7bb0168dba63 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.452668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.453484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.453765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.454208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.466117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.466901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.467251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.467592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.468533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:37.468633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.468930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.470015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.470429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.489252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 231/468] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:37.490336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:37.490984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:37.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:37.492711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:37.492711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:37.492711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:37.492711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:37.492711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 238/469] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:37.496678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.605121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b156d-6cb7-40f2-998d-f5019f164ecd None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.605636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197299d-974a-4795-81a9-33a67147d2c0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.640234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.641645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.641645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.641645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.647354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.648506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.648794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.649070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.650218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.651556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.651996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.653068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:37.672158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:37.676566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:37.677416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:37.677416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:37.677416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:37.677416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:37.677416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 232/470] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:37.677416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.771037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17994faa-7590-4b31-8559-b8b86501a6ae None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.811634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 239/471] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:37 2022] POST /identity/v3/users => generated 248 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:37.811634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.812258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.812957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.813287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.813648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.815100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:37.815468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.817465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50176292-4565-4bbf-a5f7-5707e79a966a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.835792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 233/472] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:37.837293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6aacc-f371-4536-9daf-0ac9a53c3739 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.837587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6aacc-f371-4536-9daf-0ac9a53c3739 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.837873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6aacc-f371-4536-9daf-0ac9a53c3739 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.840248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 234/473] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:37.841006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6aacc-f371-4536-9daf-0ac9a53c3739 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:37.923046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b9b57-ee8b-4de0-861a-3c425f674c3c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.959037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:37.959275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6aacc-f371-4536-9daf-0ac9a53c3739 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:37.959822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.960113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.960389 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:37.961126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:37.961437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:37.962937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2fa707-f5f6-4509-9d68-483c47db7456 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:37.976559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 240/474] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:37.980336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:37.980336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:37.980336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:38.002292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:38.003478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:38.004192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:38.004932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:38.005284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:38.005801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:38.007438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:38.008920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:38.081473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 241/475] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:38.082507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:38.124878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 235/476] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:37 2022] POST /identity/v3/users => generated 248 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:38.125725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:38.202110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7021a-6540-4559-893b-9bbc7537ecc6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:38.251677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:38.252807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:38.253297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:38.253778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:38.256466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:38.258225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:38.322128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23b5b1-626d-4997-9d7b-bc79ea7a784d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:38.347220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 242/477] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:38 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:38.371009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:38.371805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:38.372089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:38.372363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:38.373187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:38.375254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:38.420667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.sql.core [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 22:28:38.420667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 22:28:38.420667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [parameters: {'id': '70d8cbc2415746d8960045458f9a98eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 22:28:38.420667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result = self._query(query) May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application conn.query(q) May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result.read() May 03 22:28:38.438721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return ref.to_dict() May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 22:28:38.439739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application next(self.gen) May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application yield resource May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application next(self.gen) May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.session.rollback() May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.force_reraise() May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise self.value May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application session.commit() May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 22:28:38.440694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._prepare_impl() May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.session.flush() May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._flush(objects) May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application compat.raise_( May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application flush_context.execute() May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rec.execute(self) May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 22:28:38.441638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 22:28:38.442771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result = self._query(query) May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application conn.query(q) May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result.read() May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 22:28:38.443629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [parameters: {'id': '70d8cbc2415746d8960045458f9a98eb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:38.444428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 03 22:28:38.445233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:38.446075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 236/478] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 22:28:38 2022] POST /identity/v3/roles => generated 144 bytes in 315 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:38.448384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:38.573000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d8fa5-a031-415b-9ab2-2719939a7034 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:38.614142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3e568-9c1c-4f87-9337-10d9b3d2f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:38.615015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3e568-9c1c-4f87-9337-10d9b3d2f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:38.615300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3e568-9c1c-4f87-9337-10d9b3d2f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:38.615579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3e568-9c1c-4f87-9337-10d9b3d2f0d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:38.630577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3e568-9c1c-4f87-9337-10d9b3d2f0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-44f3e568-9c1c-4f87-9337-10d9b3d2f0d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:38.638978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:38.640837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 03 22:28:38.641624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:38.642674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 243/479] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:28:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:38.648233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:38.800390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54b861-ebdc-4148-ad48-04a42311591f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:38.836898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:38.837487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:38.837773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:38.838052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:38.838807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:38.839117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:38.840517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd5cef-5d5c-4812-9eef-d2e119dac9b8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:38.849544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 237/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:40.060355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335819a1-140f-4bc0-aee5-304f407c83ea None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.060858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335819a1-140f-4bc0-aee5-304f407c83ea None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.060955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335819a1-140f-4bc0-aee5-304f407c83ea None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.062559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 244/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:40.067911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.068691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.069164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.092369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:40.094476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:40.175184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 238/482] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:28:40.207135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335819a1-140f-4bc0-aee5-304f407c83ea None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:40.326085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335819a1-140f-4bc0-aee5-304f407c83ea None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:40.359727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0a0d-4610-4306-aca7-a0bcc59a244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:40.360938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0a0d-4610-4306-aca7-a0bcc59a244b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.361412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0a0d-4610-4306-aca7-a0bcc59a244b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.361884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0a0d-4610-4306-aca7-a0bcc59a244b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.372584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0a0d-4610-4306-aca7-a0bcc59a244b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-74fa0a0d-4610-4306-aca7-a0bcc59a244b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:40.381149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:40.382052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:40.382844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:40.385586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 245/483] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:40.391256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:40.485397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6c5d2-d40e-423d-a760-d7da99f81f1e None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.485714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6c5d2-d40e-423d-a760-d7da99f81f1e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.485947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6c5d2-d40e-423d-a760-d7da99f81f1e None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.487299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 246/484] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:40.492254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.492545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.492828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.500909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14df3fd-02a5-4a91-b5d9-1f4a01faf24a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:40.528819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:40.530027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:40.540811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:40.541484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.541771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.542047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.542806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:40.543121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:40.544526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:40.565917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 239/485] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:40.571316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:40.638236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 247/486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:40.671927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be996ea3-d048-4d5f-babf-bf47eae57bb5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:40.676261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:40.714847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:40.716199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.716699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.717205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.751140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:40.752656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:40.781410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:40.782318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:40.783803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:40.783803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:40.783803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:40.783803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:40.783803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 240/487] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:40.795314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:40.854479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744e1f-7ef5-4728-9fcd-49d676944b67 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:40.903685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:40.904419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:40.904694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:40.905286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:40.923371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:40.931021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:40.931927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:40.933518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 248/488] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:40.938343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:40.993209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d7e01-59bb-46fe-ac6d-73458af728be None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.032621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.036584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.036584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.036584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.036584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:41.036584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.036584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae456a-9f68-4645-829c-792c03cef7f1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.060185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 241/489] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:41.066913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26de6f-cca3-4d73-b3d8-d81823a4c6f0 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.067489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26de6f-cca3-4d73-b3d8-d81823a4c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.068015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26de6f-cca3-4d73-b3d8-d81823a4c6f0 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.070394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 242/490] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:41.071289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26de6f-cca3-4d73-b3d8-d81823a4c6f0 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.132191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46007da-25bf-45f8-92a1-33f471d4119c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.173427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.174187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.175007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.175876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.176839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:41.177467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.179725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9458-c008-49cb-a69e-39a4bb11a8d6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.192582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 249/491] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:41.194249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505135ff-7584-46cc-a036-82a8f40bbad4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.194755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505135ff-7584-46cc-a036-82a8f40bbad4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.195241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505135ff-7584-46cc-a036-82a8f40bbad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.203317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26de6f-cca3-4d73-b3d8-d81823a4c6f0 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.215540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-505135ff-7584-46cc-a036-82a8f40bbad4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:41.217261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-505135ff-7584-46cc-a036-82a8f40bbad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:41.246837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.247953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.248307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.248996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.259674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.262230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:41.279272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:41.280265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:41.281547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 243/492] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:41.282110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.297591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 250/493] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:41.299239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8f4b-f8b3-46c4-93de-6739a8031e79 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.299528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8f4b-f8b3-46c4-93de-6739a8031e79 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.299822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8f4b-f8b3-46c4-93de-6739a8031e79 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.301212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 251/494] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:41.302186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8f4b-f8b3-46c4-93de-6739a8031e79 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.381165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c215f1-9ce3-494c-a772-05be5c16ba97 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.423972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.424759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.424935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8f4b-f8b3-46c4-93de-6739a8031e79 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.425044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.425288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.435439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.437234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-566e9ae4-85fb-427a-996d-5f2e611945f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:41.454573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:41.455456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:41.456347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:41.456347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:41.456347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:41.456347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:41.456347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 244/495] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:41.457096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.457272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.457510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.462651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.463318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.463594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.463888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.464722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:41.465024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.466446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.474885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:41.476134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:41.504976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 252/496] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:41.505808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.547061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 245/497] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:41.548270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.625129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265043ef-3312-4a04-be93-4cd62b5e7c87 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.655315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bcb0b-158c-484c-9476-d170b815d162 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.660070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.660866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.661151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.661426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.672339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:41.680188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:41.681053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:41.681858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 253/498] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:41.682580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.695120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.695813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.696097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.696372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.697100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:41.697406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.698809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.709987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 246/499] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:41.710641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.788621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f459f12-0314-436b-979c-7636beff8d0b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.808171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f7dde-4552-4859-8685-b99bb8600f3c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.822823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.823871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.824325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.824777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.844698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.845492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.845780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.846058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.856278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:41.864023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:41.864909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:41.865712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 247/500] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:41.866397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:41.901345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:41.903100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:41.963239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81867364-2c16-4a25-8573-bdb77f69847d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:41.996987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:41.997709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:41.997998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:41.998276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:41.999018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:41.999361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.000804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.003674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 254/501] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:42.004569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.009111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 248/502] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:42.009902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.097380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7620c6-6940-475f-93b0-5d6b7882bc05 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.103900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2030-e2ff-4136-b50f-04cee48410a7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.129340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.130130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.130412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.130685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.136016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.136674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.136953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.137225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.137634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.138048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:42.138263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.139350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.140496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c61f9d-0ad2-49e2-8ecf-28ccf1f72bc6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.148279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 249/503] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:42.149475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf5d72-fe82-472e-aaa5-bf32b7b272ab None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.149761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf5d72-fe82-472e-aaa5-bf32b7b272ab None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.150036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf5d72-fe82-472e-aaa5-bf32b7b272ab None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.151422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 250/504] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:42.154683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf5d72-fe82-472e-aaa5-bf32b7b272ab None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:42.155275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:42.156192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:42.157112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 255/505] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:42.157688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.245918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf5d72-fe82-472e-aaa5-bf32b7b272ab None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.252823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084773-431f-43d7-8886-3c6a8dea1803 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.278275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.279043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.279323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.279594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.284932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.285700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.285979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.286256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.289777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.291216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.295867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.297660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:42.307550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:42.308558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:42.309482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:42.309482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:42.309482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.309482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:42.309482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 251/506] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:42.309904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-bc5686d9-f8e8-4ecc-8027-9d0eff47a331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:42.316451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:42.317366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:42.318189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:42.318189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:42.318189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.318189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:42.318189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 256/507] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:42.318820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.319099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.319370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.335844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:42.337034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:42.399125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 257/508] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:42.399961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.419097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b288438-8755-4e3e-890b-ce4428644d2a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.451147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.451958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.452239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.453069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.463008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.464503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:42.480836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:42.481684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:42.482539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:42.482539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:42.482539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.482539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:42.482539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 252/509] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:42.482808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.495221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ade303-92e7-4964-958c-0b9e7ed45b94 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.527823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.528409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.528686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.528960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.529774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:42.530076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.531525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.549046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 258/510] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:42.549843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.576857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dca7dd-c7fe-4ca8-806a-cfc938ec0115 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.607654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.608301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.609110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.609389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.610098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:42.610404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.611797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.622941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 253/511] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:42.623762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.648004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83a0ea-14e2-4102-a064-2a107955de54 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.680731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.681383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.681668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.681947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.682666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:42.682974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.684394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.695819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 259/512] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:42.696613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.722070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f04ae-56ec-460a-bfef-55adc6a64380 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.755254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.756070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.756353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.756625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.766487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.767945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:42.784997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:42.785901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:42.786870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:42.786870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:42.786870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:42.786870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:42.786870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 254/513] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:42.787550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.795386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493f387-1497-432f-abc4-95e0bfb48630 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.827766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.828419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.828704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.828981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.829698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:42.830004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.831368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.842744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 260/514] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:42.843404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:42.884028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c17f-b0cd-46b4-99ee-f8d4757ca651 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.916058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.916691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.916972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.917247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.935327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac7d98-19c7-4d6e-aca3-809e53666294 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:42.966417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:42.967203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:42.967495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:42.967800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:42.975855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.977297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.981955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:42.983405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:42.991933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:42.992859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:42.993735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 261/515] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:42.994597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.077768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 255/516] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:43.078537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.090858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e5ca8-b097-4a7c-b677-9402db25602b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.125161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.125949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.126231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.126506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.133792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.135248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:43.149966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:43.151483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 262/517] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:43.152422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.175224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f425b7-8b2c-492a-bb75-1e93d40b260a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.206818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.207470 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.207783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.208060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.208781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:43.209087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.210458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.221551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 256/518] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:43.222336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.247928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6da29-9943-44f8-b603-a5e0c34f5bdc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.279993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.281303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.281575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.281842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.289146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.290578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:43.304062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:43.305034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 22:28:43.305931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:43.307745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 263/519] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:43.308731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.316914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8e82b-3866-4334-ab0f-56b2df7547a8 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.348980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.349622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.349896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.350162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.350938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:43.351242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.352672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.369961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 257/520] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:43.370817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.402594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122138fa-ab4f-4428-b607-274808c8b6dc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.434026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.434809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.435085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.435360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.445584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.447049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:43.464396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:43.465308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:43.466188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:43.466188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:43.466188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:43.466188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:43.466476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 264/521] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:43.467308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.473111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4199af-dde8-4aec-be24-a8cb56431087 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.505020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.505676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.505956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.506231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.507063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:43.507371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.508834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.545323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 258/522] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:43.546162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.562206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e490c1-3c52-4719-b51d-5081b8468b1f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.594563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.595401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.596747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.598470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.600352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.601900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.638303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309bcb9-249f-4abd-8543-d973f1735022 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.670696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.671387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.671692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.671967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.672793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:43.673100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.674529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.692905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 259/523] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:43.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.723211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 265/524] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:28:43 2022] POST /identity/v3/users => generated 247 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:28:43.723901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.809756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e932c2-e123-4b7f-902e-9b177bdbf2d0 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.842011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f41dad-6075-4377-bfe0-f69b7ae50939 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:43.845696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.846361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.846642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.846917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.847794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=6d0846a688aa48a9a69fcb730dc5d7f5) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:43.848104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.849595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.859740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 260/525] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/role_assignments?user.id=6d0846a688aa48a9a69fcb730dc5d7f5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:43.859740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.885262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:43.886262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:43.886749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:43.887195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:43.888158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:43.888660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:43.891066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:43.909327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 266/526] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:43.910519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:43.999799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505558-7a4a-430c-a70d-ba435a38f24c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.043914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.044867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.045158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.045436 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.056345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545684a-4984-48d2-b206-67c1f030794a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.095431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.096354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.096781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.097230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.118247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.119741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.168039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.170066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 261/527] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:44.221530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.269640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 267/528] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:44.270796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.323317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbeb73-fde9-4630-8bd4-ae0934248a68 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.357403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.358187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.358469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.358771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.365487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.366949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.368876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818242-0ef2-40ba-90a9-e490669a424e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:44.381554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:44.382403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:44.383264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:44.387389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 262/529] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:44.388353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.406455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.411118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.411668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.412147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.423448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.425142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:44.442781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:44.443671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:44.444517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:44.444517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:44.444517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:44.444517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:44.446660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 268/530] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:44.447639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.487052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38cf6-27d3-4498-94e5-6711f8129772 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.521488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.522274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.522560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.522839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.534473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.535985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.547672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8b50-19da-407d-85f9-87f354ee32b7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:44.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:44.554345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:44.555192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:44.555192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:44.555192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:44.555192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:44.559348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 263/531] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:44.560319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.585600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.586612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.587087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.587554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.588562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:44.589082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.590697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.613226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 269/532] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:44.614451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.661600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b427ec-53ce-4e05-a92a-f5728ba42be7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.697535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.698202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.698486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.698766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.699496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:44.699873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.701373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.713993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 264/533] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:44.714640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.728091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849f174-2ec4-4cd0-98b8-e4eb09a32b76 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.770655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.771468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.772076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.772366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.773393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:44.773701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.775710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.791042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 270/534] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:44.791905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.820615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d8d38-1b80-4fb9-a41c-7c1927d1f64f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:44.856284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:44.857089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:44.857507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:44.857781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:44.859324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=bffce7ed1d0d4606914bc071da22801a) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:44.859990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:44.861872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:44.869219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 265/535] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/role_assignments?user.id=bffce7ed1d0d4606914bc071da22801a&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:44.870249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:44.942777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753dafc2-4158-45d2-bb8e-a6e2b3e1a516 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:45.021540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:45.022343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:45.022616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:45.022885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:45.040801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:45.042345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:45.074113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:45.075017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:45.075864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 271/536] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:45.081586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:45.088660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba893f13-2d1c-496c-a286-3ab1da439ae9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:45.134991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:45.136494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:45.136494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:45.136494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:45.148958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:45.150405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:45.176342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:45.178352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:45.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 266/537] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:45.187626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:45.216290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3eb6-4f78-4947-91b3-ef1f00e56891 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:45.253555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:45.254210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:45.254484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:45.254755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:45.255534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:45.255864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:45.261219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:45.282742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 272/538] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:45.292623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:45.334315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479f15d-b268-4568-baaf-187258b65715 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:45.368518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:45.369183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:45.369466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:45.369745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:45.370535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:45.370844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:45.372324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:45.384289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 267/539] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:45.390008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:45.496598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0919d3-9898-4d63-81d1-ae11e6d33a75 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:45.508499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109b618-97bb-42b7-9927-edea36eecf38 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:45.531146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:45.531826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:45.532111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:45.532387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:45.533227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=843f6ae9b5864f00bfea0ea2ab02d552) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:45.533534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:45.534973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275634c-1755-4e80-8a4e-7ea232d0c9e8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:45.540978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 268/540] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:45 2022] GET /identity/v3/role_assignments?user.id=843f6ae9b5864f00bfea0ea2ab02d552&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:45.576505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:45.577200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:45.578029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:45.578370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:45.579229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=5ec2e18cb1804b6f94d646491f8c20c5) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:45.579537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:45.581039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1109cfb-b628-4fe9-9445-b44e6fec3bbd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:45.587828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 273/541] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:45 2022] GET /identity/v3/role_assignments?user.id=5ec2e18cb1804b6f94d646491f8c20c5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:46.152477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe3cb-a979-458b-9c58-5009e51143c4 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.152852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe3cb-a979-458b-9c58-5009e51143c4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.153042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfe3cb-a979-458b-9c58-5009e51143c4 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.154632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 269/542] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:46.160103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.160390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.160662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.180566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:46.181770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:46.263991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 274/543] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:46.286517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe3cb-a979-458b-9c58-5009e51143c4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:46.436262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfe3cb-a979-458b-9c58-5009e51143c4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:46.483125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:46.483985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.484264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.484533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.500451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:46.508375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:46.509242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:46.510036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:46.516308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 270/544] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:46.522378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:46.671769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1428fa5-c940-4d72-8b88-f25ecd2d2752 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:46.717411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:46.718107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.718395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.718671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.719488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:46.719830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:46.721262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f4182-fd09-4237-80f7-10e9006a9f0f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:46.735256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 275/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:46.740425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:46.759863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df963-7b8f-4422-b084-48306f73a046 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.760150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df963-7b8f-4422-b084-48306f73a046 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.760603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6df963-7b8f-4422-b084-48306f73a046 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.763429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 276/546] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:46.768550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.769068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.769502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.796259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:46.798352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:46.929674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070097d5-2385-49b2-a8ee-f6771a439092 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:46.937137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 277/547] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:46.982732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:46.983593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:46.983927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:46.984201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:46.998114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.000150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.004740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:47.022565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:47.023433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:47.024347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:47.024347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:47.024347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:47.024347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:47.026690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 271/548] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:47.034870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.145648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a5c56-6b02-4412-afe0-ce2b25023751 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.182922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.183589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.183900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.184183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.184921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:47.185233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.187227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.190936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b01e9b-8989-43ef-9fe9-5256aa1e2c19 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.200154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 272/549] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:47.205834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.239274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.240119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.240399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.240668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.260589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:47.268853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:47.270140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:47.270931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 278/550] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:47.277921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.307935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213b1e6-8dc9-47cf-b3d1-0da08c74f12b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.341899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.342688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.342999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.343275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.350792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.352723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:47.369135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:47.371223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:47.373382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 273/551] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:47.379646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.459353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff874-a10e-4428-969d-894d6de74035 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.491846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1fc14-5be6-4029-b4b2-a0e90dfe8d64 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.494619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.495306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.495586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.495887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.496639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:47.496940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.498322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd856674-11e5-4d44-a0a2-61a6039c047b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.509012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 279/552] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:47.510861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b650a-4524-46d2-9cea-bed6a7237003 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.511143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b650a-4524-46d2-9cea-bed6a7237003 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.511418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b650a-4524-46d2-9cea-bed6a7237003 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.515766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 280/553] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:47.516487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b650a-4524-46d2-9cea-bed6a7237003 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.536071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.536667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.537099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.537376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.538595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:47.538901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.540907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9415bfe-c503-4ef8-91ec-f96313f7027d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.559572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 274/554] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:47.565090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.565384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.565667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.583299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:47.584573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:47.639515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b650a-4524-46d2-9cea-bed6a7237003 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.670882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 275/555] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:47.671877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.685957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.687333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.687631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.687914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.705369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.706825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:47.729844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:47.731890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:47.734040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:47.734040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:47.734040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:47.734040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:47.734040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 281/556] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:47.734040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:47.780278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d40e6-9464-49c1-a211-ca25bc82c9a0 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.819337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.820720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.821200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.821692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.869080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c396e-77a9-4569-b54d-eb27397929f9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:47.897819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:47.899744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:47.904363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:47.905529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:47.906050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:47.906514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:47.917537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:47.926122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:47.927017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:47.927835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:47.930525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 282/557] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:47.931585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.014185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 276/558] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:48.015243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.060385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715d04-7705-4279-8d44-9975e7129768 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.095050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.096147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.096636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.097139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.098094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:48.098614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.100298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.121240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 283/559] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:48.122678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.126839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c03ee5-c865-4fef-bad9-883d2716945f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.161927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.162591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.162889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.163154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.163944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:48.164251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.165637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.174695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 277/560] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:48.175391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.231221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f9888-1c55-402c-9e0d-c32e58049578 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.265493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.266276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.266560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.266834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.276761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.278861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dbb5c-b702-472e-aec3-73ede040005a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.278997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:48.297444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:48.298970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:48.300217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:48.300217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:48.300217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:48.300217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:48.300217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 284/561] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:48.300217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.313898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.314753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.315101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.315383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.322687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.324163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-5ed844b4-7ba8-4364-9c0c-2129fd9994be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:48.337543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:48.338782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 278/562] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0478-7018-4054-a08b-d04dc61d6a8a None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.340575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0478-7018-4054-a08b-d04dc61d6a8a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.342464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba0478-7018-4054-a08b-d04dc61d6a8a None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.342464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 279/563] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:48.343661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a905-01db-4a33-a2bc-23a5bcf7c466 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.343948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a905-01db-4a33-a2bc-23a5bcf7c466 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.344224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416a905-01db-4a33-a2bc-23a5bcf7c466 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.345483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 280/564] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:48.346121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a905-01db-4a33-a2bc-23a5bcf7c466 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.396600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca9365-63de-486a-bb8a-025e99c0075d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.429018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.429800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.430082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.430358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.440192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.440489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416a905-01db-4a33-a2bc-23a5bcf7c466 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.441630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:48.458471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:48.459436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:48.460362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:48.460362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:48.460362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:48.460362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:48.460362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 285/565] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:48.460642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.478460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.479113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.479399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.479708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.480429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:48.480733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.482076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701561c-657c-4e94-86e1-70bd3e34a48b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.494144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 281/566] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:48.495161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4979-0d7c-462c-bce4-51d85ab303bd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.495442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4979-0d7c-462c-bce4-51d85ab303bd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.495748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4979-0d7c-462c-bce4-51d85ab303bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.510851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-667d4979-0d7c-462c-bce4-51d85ab303bd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:48.512067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-667d4979-0d7c-462c-bce4-51d85ab303bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:48.576406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 282/567] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:48.578211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.578495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.578767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.586557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607fed-c477-4619-8e49-ae18f5bddfe9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.596578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:48.598363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:48.628151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.628780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.629064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.629342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.630991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:48.631513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.633047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.652313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 286/568] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:48.653148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.668554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 283/569] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:48.669398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.753622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812926e-c107-4248-a304-e3ee657e217a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.764412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7c96e-ee85-4559-9670-e7725f9ac02d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.786280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.786924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.787203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.787473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.788221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:48.788519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.789876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.796926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.797706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.797990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.798266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.800616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 287/570] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:48.801488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.805004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.806454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:48.819812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:48.820851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 284/571] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:48.826380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.902814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635ff77-73f8-4bc5-bdd2-01b4a7986460 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.916187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7032bd1-5a49-4e63-bc76-ca7f1b777dcd None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:48.933326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.934101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.934379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.934649 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.944627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:48.947704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:48.948475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:48.948758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:48.949036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:48.952112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:48.953719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 288/572] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:48.955028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:48.959881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:48.961331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:48.978127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:48.979131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:48.980192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:48.980192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:48.980192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:48.980192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:48.980192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 285/573] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:48.980192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.063433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157ce2-cbce-4f96-93ed-0924ab90aae8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.082545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5ea6-c05b-473a-a058-c491e594e937 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.095006 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.095820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.096103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.096377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.105979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:49.113420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:49.113567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:49.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:49.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:49.116504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.116504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.116504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.119688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 289/574] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:49.120437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.122403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.123867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:49.138076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:49.143806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 286/575] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:49.144926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.220370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b4cdc-6587-4eb2-a282-fdf036a299c9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.235781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690adace-48ea-4597-acaf-75ab941b9ccc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.252971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.253620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.253900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.254175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.254956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:49.255269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.256735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.268017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.268664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.268940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.269211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.269300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 290/576] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:49.269954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:49.270049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.270389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.271695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.280115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 287/577] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:49.280947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.362582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeee3b-9679-4782-8ab0-fdcd6140a776 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.391082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccacd5-d1e9-43c4-80dc-be2efaca8c31 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.402062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.402731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.403013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.403287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.404057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:49.404363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.405766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.416883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 291/578] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:49.417686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.425950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.426616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.427715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.427996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.428751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:49.429057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.431205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.440663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 288/579] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:49.441440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.514187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe99e2f-3ca3-499a-b2b7-9647c11c051b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.536823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7bc2e-10ed-4e44-b1de-43a8ada0dbee None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.544642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.545297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.545570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.545836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.547189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:49.547494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.548929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.566141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 292/580] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:49.566918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.569349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.570002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.570290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.570581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.571388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=f7b72281fc3f423094ed8df450d84db7) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:49.571729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.573153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.591635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 289/581] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/role_assignments?user.id=f7b72281fc3f423094ed8df450d84db7&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:49.591635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.699189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c44f7b-3d75-4233-b7b5-905bd6baf126 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.706148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696c1cb-89ba-431e-ba2c-84dff5ee08f3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.742077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.742979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.743325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.743681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.744116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.744988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.745334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.745681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.753025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.754605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.755135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.756616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:49.770375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:49.771298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:49.772631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 290/582] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:49.773352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:49.776251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:49.788359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:49.789296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:49.789296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:49.789296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:49.789296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:49.789296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 293/583] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:49.789296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.877003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7f50f-a04d-4e2f-83ad-41cb43c0864a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.881053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeebd30-5b5f-4d46-bcdb-592b51517612 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:49.910446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.911234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.911512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.911816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.914497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:49.915284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:49.915560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:49.915887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:49.922420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.923904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.926747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:49.928330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:49.941714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:49.942794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:49.944013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:49.944013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:49.944013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:49.944013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:49.947491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 291/584] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:49.948169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:49.949340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:49.950463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:49.950463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:49.950463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:49.950463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:49.950727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:49.951718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 294/585] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:49.952610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.056186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd709fa-57e2-48c3-a357-6ab00f86e0d3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.062668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4ebc-45d5-477c-abbb-df86f97af038 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.091446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.092259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.092541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.092834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.094150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.094572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.096314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.101952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.102826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.103250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.103724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.104605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.105053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.106552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.108633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 292/586] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:50.109261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.122829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 295/587] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:50.123878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.209147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc756e4-8c16-4db5-ba34-cf0f2a3b73ad None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.226595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fd220-e4a8-433f-bace-2481b43cc17d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.241236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.241891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.242172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.242445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.243168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.243628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.244853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.257651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 293/588] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:50.258458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.264478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.265646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.265927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.266198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.266920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.267225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.268649 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.281180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 296/589] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:50.282314 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.358816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20329-67bd-4f4b-b210-a6a81315e811 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.378190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330e678-c31b-4915-a01d-eead3599ac99 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.394621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.395506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.395813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.396087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/6d0846a688aa48a9a69fcb730dc5d7f5/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.412856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=6d0846a688aa48a9a69fcb730dc5d7f5, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.413388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.414193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.414308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.414466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.414735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.422028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.423495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:50.438269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:50.439390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 297/590] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:50.440584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.488654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 294/591] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:50 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/6d0846a688aa48a9a69fcb730dc5d7f5/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:50.489852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.541282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac2b6-6c79-4429-89b4-7b514aa41038 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.590354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.591231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.591516 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.591819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.602199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.603940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.613518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5201a-6fdc-4759-99cc-cf76d9eb506b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:50.623978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:50.625553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 22:28:50.626500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:50.631272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 298/592] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:50.632296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.660539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.661725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.662233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.662718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.671028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.672914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:50.690095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:50.691040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:50.692660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:50.694994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 295/593] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:50.700256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.757170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861fd5e-fab7-4bab-a015-73d89ebce42f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.793057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.794079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.794592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.795080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.796813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.797346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.799025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.813585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264f1b1-f63a-432c-b071-6a1ef3acd56f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.817981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 299/594] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:50.819119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.848334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.849076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.849356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.849633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.850633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.850942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.853008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:50.879794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 296/595] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:50.881090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:50.942128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e578e6-2610-4370-a955-ba77de8e5dff None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.987255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043759d-6698-4f45-ab5f-680e63004aef None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:50.991869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:50.992537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:50.992826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:50.993105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:50.993898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:50.994206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:50.995642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.007893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 300/596] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:51.008694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.028534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.030153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.030747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.031203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.044466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.046943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:51.069518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:51.070452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:51.071363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:51.071363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:51.071363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:51.071363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:51.077501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 297/597] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:51.077501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.145024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be94527-2939-4040-b08d-64d5e72945ac None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.177748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e458e78-55ac-4f34-88e8-ba2659ba36e2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.184343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.185565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.185565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.185771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.197461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.198944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.213227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.214109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.214386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.214659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/bffce7ed1d0d4606914bc071da22801a/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:51.216253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:51.218761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:51.220198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:51.220198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:51.220198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:51.220198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:51.220198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 301/598] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:51.220198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.232018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=bffce7ed1d0d4606914bc071da22801a, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.234144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.312335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 298/599] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:51 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/bffce7ed1d0d4606914bc071da22801a/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:51.313787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.342335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b8788-3fd2-463a-96f2-43f382e06a13 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.407012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.407673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.407931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.408220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.408977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:51.409279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.410673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.440092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 302/600] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:51.444298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.494104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b5c6e-0574-4797-8cae-a1fa51f38731 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.535927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.536596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.536878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.537154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.537882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:51.538189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.539566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.552166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 299/601] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:51.557545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.612592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52fef0-9c8c-4911-a230-ad9999a872bb None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.649722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.650510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.650791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.651123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.659218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.660819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.670337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a72ae-25ed-435e-adb9-4844595c5918 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:51.677517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:51.683369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:51.684553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 303/602] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:51.685032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.708461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.709273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.711769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.711769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.721323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.722753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:51.741517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:51.742666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:51.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:51.745578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 300/603] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:51.751196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.817706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715f644-bd88-4d8d-b685-54cc54a50bd4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.855233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.856105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.856460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.856746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.857542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:51.857852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.859654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d682-5c90-436c-9fb9-b4380178be8e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:51.859847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.873027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 304/604] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:51.879316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:51.899348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:51.900048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:51.900486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:51.900773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:51.901570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:51.901882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:51.903318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:51.917394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 301/605] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:51.923790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:52.043772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d2f0e-df78-4303-9eea-fa18d3a79d5d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:52.077556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34625174-cc2d-4cf5-98a3-57e4dec8a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:52.078443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625174-cc2d-4cf5-98a3-57e4dec8a796 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.078727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625174-cc2d-4cf5-98a3-57e4dec8a796 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.079007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34625174-cc2d-4cf5-98a3-57e4dec8a796 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/843f6ae9b5864f00bfea0ea2ab02d552/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.091336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a15fce-ec8f-4349-b274-e4d0df21dd86 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:52.097375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625174-cc2d-4cf5-98a3-57e4dec8a796 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=843f6ae9b5864f00bfea0ea2ab02d552, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:52.098943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34625174-cc2d-4cf5-98a3-57e4dec8a796 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:52.128138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:52.129056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.129332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.129614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/5ec2e18cb1804b6f94d646491f8c20c5/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.144244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=5ec2e18cb1804b6f94d646491f8c20c5, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:52.145675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:52.183808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 302/606] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:51 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/843f6ae9b5864f00bfea0ea2ab02d552/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:52.183808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54340-39b9-4683-a2ff-50c6ccde3563 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.183808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54340-39b9-4683-a2ff-50c6ccde3563 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.183808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54340-39b9-4683-a2ff-50c6ccde3563 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.183808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 303/607] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:52.189222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.189674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.190184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.209280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:52.210896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:52.219731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 305/608] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:51 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/5ec2e18cb1804b6f94d646491f8c20c5/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:28:52.311187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 304/609] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:52.339759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:52.466138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8907c47-dc34-4bff-93c8-e7bf4a8782f9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:52.499801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:52.500596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.500929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.501199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.511513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:52.520237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:52.521181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:52.522046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 306/610] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:52.527501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:52.646884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc29c7a-7304-43c9-8ca0-400864d79126 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:52.680937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:52.681685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.681862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.682133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.682884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:52.683188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:52.684607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:52.693738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 305/611] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:52.704011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:52.851176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d978c-6a78-4d75-b5d7-c265a3cc2e13 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:52.892731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:52.893570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:52.893854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:52.894127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:52.909642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:52.911093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:52.931974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:52.934013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:52.936252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:52.936252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:52.936252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:52.936252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:52.936252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 307/612] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:52.939521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.072262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aaa3c-6fef-4738-934f-6dab126d1fc1 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:53.106292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:53.106879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.107159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.107429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.108182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:53.109043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:53.110388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d672c-5fe4-4b4a-9957-a0550e73ae36 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:53.122474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 306/613] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:53.128679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.265297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729358b4-5c45-4f55-a148-652b1dda96f8 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.265586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729358b4-5c45-4f55-a148-652b1dda96f8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.265933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729358b4-5c45-4f55-a148-652b1dda96f8 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.271251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 307/614] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:53.273851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.274204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.274676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.292609 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:53.293997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:53.301636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d01dc-e4b7-4abf-bfc5-63f2ff16e330 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:53.368518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 308/615] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:53.376467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:53.377265 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.377548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.377883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.385973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:53.387469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:53.395961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:53.402824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:53.403782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:53.404728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 308/616] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:53.412116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.584528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc401-9574-4bf6-abe5-fda3fd45567c None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:53.600286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064c71f-9d43-4201-a9f1-5ecdb09fa93d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:53.657856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:53.658578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.658857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.659131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.663163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:53.663856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.664141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.664471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.665321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:53.665629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:53.667061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:53.684345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:53.694239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:53.695452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:53.697387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 309/617] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:28:53.700316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 309/618] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 22:28:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:28:53.707719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.707866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.819036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27d247-9924-4d4a-a9ed-d4bb6919b9da None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:53.860576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:53.862808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.864234 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.864791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:53.893401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:53.897379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:53.926002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:53.926902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:53.927805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:53.927805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:53.927805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:53.927805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:53.929998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 310/619] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:53.936315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:53.939654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21410c2-aeeb-46d0-8b82-d122c01f6116 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:53.996874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:53.998020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:53.998491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:53.999107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.000657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:54.001104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.003597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.052248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 310/620] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:54.056558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.173761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e572e82-85ad-41bc-b95c-c033afd2fac2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.213503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.214555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.215052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.215527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.216485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:54.216991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.218638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931e74b-5ff1-4720-a82d-38abf641a64a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.230738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 311/621] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:54.232418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f595ff-4240-418e-bd0b-c58a04678b46 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.232911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f595ff-4240-418e-bd0b-c58a04678b46 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.233420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f595ff-4240-418e-bd0b-c58a04678b46 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.235120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 312/622] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:54.236074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f595ff-4240-418e-bd0b-c58a04678b46 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.244584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b2b96-34fb-4b17-800a-27dbaf7ac783 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.288319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.289285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.289574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.289855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.303707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.305457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-66ff61e2-22cf-45cf-8260-a8c370803c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:54.328509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:54.329475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:54.330381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:54.330381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:54.330381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:54.330381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:54.330381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 311/623] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:54.331265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.331551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.331854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.350726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f595ff-4240-418e-bd0b-c58a04678b46 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.352262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:54.354400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:54.388175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.390209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.390798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.391270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.399029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.400841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:54.415635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:54.416570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:54.417453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:54.419889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 313/624] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:54.420997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.439707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 312/625] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:54.440941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.538039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f580-22bf-4e1f-8c06-554f11c35d44 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.567598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601e7d-a900-4593-b9ad-7997203c8336 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.573851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.574783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.575310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.575894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.576874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:54.577426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.579011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.591105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 314/626] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:54.592275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.602286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.602949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.603232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.603511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.604338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:54.604931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.606085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.618828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 313/627] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:54.619716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.700315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22c358-7d85-45bd-b375-d2de6eae208f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.724523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494bce07-2aef-4f40-a258-3cb155e4dcae None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.736247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.737405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.737931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.738409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.750017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:54.758180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:54.759076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:54.760111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:54.760757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.760757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.760903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.761509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.763315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 315/628] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:54.764693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.775952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.777818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:54.798453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:54.799447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:28:54.800453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:54.803431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 314/629] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:54.804789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:54.891973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474c63cd-cabc-4da4-b97f-41e71a4a496f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.910379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7731-fd4e-43ed-8e21-57229f9736f5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:54.930466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ce79e-5a71-4810-9737-aea53b14d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.931638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ce79e-5a71-4810-9737-aea53b14d535 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.931917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ce79e-5a71-4810-9737-aea53b14d535 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.932194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ce79e-5a71-4810-9737-aea53b14d535 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/f7b72281fc3f423094ed8df450d84db7/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.943395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:54.944164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:54.944513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:54.944858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:54.945684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:54.946082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.947521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.948983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ce79e-5a71-4810-9737-aea53b14d535 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=f7b72281fc3f423094ed8df450d84db7, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:54.950813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ce79e-5a71-4810-9737-aea53b14d535 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:54.955764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 315/630] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:54.956776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.031573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 316/631] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:28:54 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/f7b72281fc3f423094ed8df450d84db7/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:28:55.032969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7412612-4e6a-4f9a-944c-f3e9f25dbf96 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.033266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7412612-4e6a-4f9a-944c-f3e9f25dbf96 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.033586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7412612-4e6a-4f9a-944c-f3e9f25dbf96 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.034938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 317/632] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:55.035519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7412612-4e6a-4f9a-944c-f3e9f25dbf96 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.062934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604f7b0-5bbd-4645-be85-67923b62fe53 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.098996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.099728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.100010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.100289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.101139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:55.101448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.102917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493eef-8004-40ec-b32b-033106b760a7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.128623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 316/633] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:28:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:55.128623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6a28-e41d-416a-bd2e-8234f1fd9e4c None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.128623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6a28-e41d-416a-bd2e-8234f1fd9e4c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.128623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c6a28-e41d-416a-bd2e-8234f1fd9e4c None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.128623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 317/634] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:55.129085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.129085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.129768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.147488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:55.148732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:55.154067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7412612-4e6a-4f9a-944c-f3e9f25dbf96 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.190491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.191308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.191587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.191891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.202715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.204355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.224769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 318/635] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:55.225629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a0f7a471-b011-4d77-8804-161ad1053e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:55.226044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:55.226904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:55.228206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:55.228206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:55.228206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:55.228206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:55.228206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 318/636] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:55.228744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.229028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.229945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.247952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:55.249661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:55.321814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 319/637] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:55.323635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.324380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037739d-b0a4-4ae6-9787-be5a36ef97fe None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.368243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811505-2061-489a-bafd-94392beeba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.369570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811505-2061-489a-bafd-94392beeba39 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.370300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811505-2061-489a-bafd-94392beeba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.370783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811505-2061-489a-bafd-94392beeba39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.420436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4339ee-7827-4150-b148-2da9e538e309 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.437082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44811505-2061-489a-bafd-94392beeba39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.438537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44811505-2061-489a-bafd-94392beeba39 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.452894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.453553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.453829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.454099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.454814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:55.455116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.456506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.469063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 320/638] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:55.469309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.541384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 319/639] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:55.542552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811505-2061-489a-bafd-94392beeba39 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.569578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7b72b-d736-40e3-9858-99eca17dc9b1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.604159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.604944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.605226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.605500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.615782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:55.623329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:55.625104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 321/640] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:55.625940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.642388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811505-2061-489a-bafd-94392beeba39 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.675935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.676731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.677006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.677286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.687502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:55.695206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:55.696218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:55.697068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 320/641] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:55.697792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.747856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd2db1-c573-4e50-b9a7-6594a2e34375 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.782857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.783673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.783954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.784234 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.791626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.793084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:55.807451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:55.808749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 322/642] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:55.809989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.827253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abf86e-19fa-46a3-80f9-f8067a335217 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.862637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.863355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.863655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.863935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.874220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.875687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:55.894059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:55.894982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:55.896365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:55.896365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:55.896365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:55.896365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:55.896365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 321/643] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:55.896365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:55.911167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19fb05-144f-4ce8-abf7-6e9df4643827 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:55.944014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:55.944681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:55.944962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:55.945238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:55.945990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:55.946298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:55.947689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:55.959965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 323/644] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:55.959965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.010370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0865a-408a-4a5a-af39-2d6d09f22d38 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.044291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.044957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.045240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.045522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.046310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:56.046618 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.048014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.053842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c621b-2b77-434c-af8c-654f01b9f973 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.056237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 322/645] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:56.057129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.090169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.090838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.091114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.091389 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.092258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:56.092567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.094580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.111558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 324/646] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 22:28:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:56.112392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.162745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7db55-9c3e-447d-9865-11ec79086cf9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.196388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.197302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.197737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.198163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.199343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:56.199878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.201809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.219023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 323/647] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:56.219023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.219271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631aef0-9318-488a-9b86-8dc01cd3fe9a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.253838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.254626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.254902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.255175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.265837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.267327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:56.285150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:56.286022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:56.286953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:56.286953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:56.286953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:56.286953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:56.286953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 325/648] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:56.287780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.315319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d216e0-4abb-41dc-b336-9979d7cec12e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.348329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.349121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.349404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.349682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.359635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.361030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:56.378403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:56.379289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:56.380294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:56.380294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:56.380294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:56.380294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:56.380294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 324/649] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:56.380574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.387059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2257b-8ec1-4240-a95c-aad1c5715dae None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.421135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.421713 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.421995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.422270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.479758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96b8cb-778c-4f22-bcec-9b2cf70b8e02 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.489158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.490845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.513393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.514435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.515345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.515635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.522488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.523969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:56.537657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:56.538570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:56.539477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 325/650] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:56.539999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.591506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 326/651] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:56.592593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.651984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886106-8224-4e10-bac8-52d3ade34ca6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.687221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.687221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.687221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.687221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.687690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:56.687690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.688453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.689885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cb500-4e10-4657-a507-5d1a48b841b0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.704813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 326/652] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:56.704813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.728435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.729100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.729384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.729664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.730390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:56.730697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.732116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.743206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 327/653] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:56.748316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.814072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d032ba7-209f-48eb-aa71-ed7d3d977434 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.847772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.848525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.848725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.848980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.849079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc5114-dfbc-4a96-959d-08e285cf9e46 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:56.849772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:56.850087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.851523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.864341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 327/654] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:56.865541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.888443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:56.890223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:56.890721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:56.891423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:56.904219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:56.905736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:56.922967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:56.924210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:56.925118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:56.925118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:56.925118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:56.925118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:56.925118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 328/655] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:56.925404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:56.966594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1d84-86b1-4d1f-80cb-5ec9601f35a2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.004511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.005309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.005593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.005900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.013338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.015074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.026847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195c516-0956-450b-a7dd-4bf1ef317b85 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:57.028928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:57.030061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 328/656] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:57.031051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.070748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.071555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.071866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.072145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.079923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.081489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:57.095223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:57.096406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:28:57.097591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:57.103003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 329/657] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:57.103003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.141861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817ba8-9ddf-4a69-9d92-364fe8a9a606 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.176700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.177356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.177638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.177911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.178743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=6d0846a688aa48a9a69fcb730dc5d7f5) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:57.179052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.180506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.195637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 329/658] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/role_assignments?user.id=6d0846a688aa48a9a69fcb730dc5d7f5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:57.195637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.219101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0d94-1754-4d85-b8f1-3d225da60ff8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.261999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.262775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.263120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.263454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.264594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:57.264969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.267020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.283766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 330/659] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:57.289101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.319652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65a312-39d1-44ff-b683-23e0b641fd0e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.354941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.355640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.355926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.356203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.357054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:57.357363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.359405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.381903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 330/660] 10.222.0.23 () {56 vars in 1139 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:57.381903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.396304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47bd9c-7830-4e64-8f36-673d5e1578f8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.446618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.447920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.448302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.448581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.449429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:57.449732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.451179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fade6-117c-48ff-b0c1-24d025901b09 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.475718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 331/661] 10.222.0.23 () {56 vars in 1137 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:57.476039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142c41-4826-4dbc-af1e-f0b0d49eb97c None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.476422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142c41-4826-4dbc-af1e-f0b0d49eb97c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.476792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142c41-4826-4dbc-af1e-f0b0d49eb97c None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.478376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 332/662] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:28:57.479326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142c41-4826-4dbc-af1e-f0b0d49eb97c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.484761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15d695-fb36-417e-b5e7-77894eb79171 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.520641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.521798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.522294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.522760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.532132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.533675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:57.547093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:57.548221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:57.549326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:57.554607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 331/663] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:57.554607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.588282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142c41-4826-4dbc-af1e-f0b0d49eb97c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.622032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e0daa-10fe-4e08-906d-0033ea4e994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.622912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e0daa-10fe-4e08-906d-0033ea4e994f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.623189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e0daa-10fe-4e08-906d-0033ea4e994f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.623460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e0daa-10fe-4e08-906d-0033ea4e994f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.645331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd0c7e-7130-4a31-81a5-fae955d65f43 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.677598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.678246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.678522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.678796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.689993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e0daa-10fe-4e08-906d-0033ea4e994f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.691551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e0daa-10fe-4e08-906d-0033ea4e994f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.744469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.746055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.799382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 333/664] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:57.801024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.801308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.801584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.820023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:57.821087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:57.846656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 332/665] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:28:57.847633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.894147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 334/666] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:57.895041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:57.947286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a61ae-fe23-4d5e-8579-f069e92e8af2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:57.981974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:57.982630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:57.982920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:57.983193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:57.984036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:57.984350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:57.985775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:57.997169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 333/667] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:57.997918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.013311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff77e1-3307-472c-96c2-13d561837fc3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.048789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.049584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.049865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.050142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.060384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:58.080240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:58.081138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:58.082026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:58.082026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:58.082026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:58.082026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:58.084043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 335/668] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:58.085234 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.099819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea622be-4755-48d8-aa6d-74474e0e5794 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.131506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.132317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.132590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.132865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.143747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.145176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:58.161475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:58.162535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:58.163706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:58.163706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:58.163706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:58.163706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:58.163706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 334/669] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:58.163999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.189931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64754-381a-4b69-b358-152696ae9ced None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.222856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.223925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.224199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.224492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.234912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:58.242919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:58.244077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 336/670] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:58.250322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.268781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96c35d-201d-4ceb-a6fb-bc40c79a500d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.302794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.303533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.303901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.304237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.305133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=bffce7ed1d0d4606914bc071da22801a) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:58.305678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.307188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.323837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 335/671] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/role_assignments?user.id=bffce7ed1d0d4606914bc071da22801a&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:58.323837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.351195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbbeef-02b5-4e12-99c7-8c60a557e3a1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.389846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.390531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.390810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.391081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.391880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:58.392189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.393628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.407156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 337/672] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:58.407859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.432388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b2df0-67be-4612-a4b1-11b38dd4b64a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.468249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.471356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.471356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.471356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.471356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:58.471356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.471894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.485439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 336/673] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:58.486360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.515963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107dcfcb-8170-4d78-bc69-1fd24a2b630e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.552389 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.553391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.553828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.554103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.554864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:58.555178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.556569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.570080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 338/674] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:58.576283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.597538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca6e97-54ed-4788-be03-f1b247b23b91 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.641246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.647356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.647356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.647356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.651528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.653287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:58.673655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:58.676418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 337/675] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:58.677750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.702411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4927e-071d-41e0-a4c8-bc62d107d4e6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.738601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.739495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.739870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.740209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.747537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.749191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:28:58.764877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:58.766834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:28:58.769312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 339/676] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:58.775637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.797480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c110e-cccd-4c69-85d8-b2eaa1ed9bf9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.841908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6610c-864e-486b-9760-255062453142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.843389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6610c-864e-486b-9760-255062453142 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.844469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6610c-864e-486b-9760-255062453142 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.844755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6610c-864e-486b-9760-255062453142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.857623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6610c-864e-486b-9760-255062453142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.860096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6610c-864e-486b-9760-255062453142 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.874145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292e5ec-e6c2-4d5b-8669-664ef1bcf615 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-77c6610c-864e-486b-9760-255062453142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:28:58.881007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:58.882096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:58.883904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:28:58.883904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:28:58.883904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:28:58.883904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:58.883904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 338/677] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:58.883904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6610c-864e-486b-9760-255062453142 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.924119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:58.924779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:58.925061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:58.925335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:58.926128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:58.926435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:58.928330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:58.943221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 340/678] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:58.944392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:58.998619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6610c-864e-486b-9760-255062453142 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.034007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.034903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.035330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.035781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.036713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:59.037166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:59.038757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:59.055722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 339/679] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:59.056989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:59.064584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ee036-0b65-448a-aa3e-beddf9ec3696 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.101856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.102815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.103287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.103756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.104619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:59.105069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:59.106648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:59.123776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 341/680] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:59.124936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:59.169151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08eeb-44d1-43ce-9c18-66430f6a28d3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.203034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.203726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.204009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.204489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.205104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=843f6ae9b5864f00bfea0ea2ab02d552) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:59.205412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:59.206827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:59.213178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 340/681] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/role_assignments?user.id=843f6ae9b5864f00bfea0ea2ab02d552&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:59.213926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:59.229530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6da77c-5985-4b64-b83b-9cfbc61addcf None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.267739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.268722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.269152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.269572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.270597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=5ec2e18cb1804b6f94d646491f8c20c5) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:59.271083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:59.272953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:59.279994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 342/682] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/role_assignments?user.id=5ec2e18cb1804b6f94d646491f8c20c5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:59.353815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2520c-339d-4426-854d-167a0271cd01 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.402728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.403550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.403856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.404134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.416873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:59.418356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-95fde388-9ff0-443f-be92-a32cbb1dee02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:28:59.440965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:59.441983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:59.442962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 341/683] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:59.453364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:59.586821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745624b-bd43-415d-816c-9c65c7f14c1d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.587168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745624b-bd43-415d-816c-9c65c7f14c1d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.587361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745624b-bd43-415d-816c-9c65c7f14c1d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.588652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52cc1b-1d1a-4c9a-820b-5937c53e6ca0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.588804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 342/684] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:28:59.594631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.595164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.595819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.619341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:28:59.620504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:28:59.631768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.632501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.632751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.633030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.633901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:28:59.634211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:28:59.635723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:28:59.660162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 343/685] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:28:59.665339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:59.722020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 343/686] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:28:59.747224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:28:59.781538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5dc42-af8a-4f6d-aa24-1d03994824dd None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.856532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.857183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.857458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.857724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.911666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49959b05-7ef8-42b2-b9f3-b4b8ce558801 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:28:59.957861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:28:59.958650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:28:59.958926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:28:59.959198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:28:59.969928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:28:59.977409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:28:59.978346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:28:59.979198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:28:59.983353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 344/687] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:28:59.984532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.036711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.038157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.083342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247caafb-2eb8-4b9f-953d-b776015cecc6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.116884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.117542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.117818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.118086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.118824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:00.119124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.120799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.140195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 345/688] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:00.142684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.253357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d087e-b2e2-4167-b440-3eb9c6a27c9a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.289527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.290318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.290594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.290864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.298710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 344/689] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:29:00.302404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.304046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.304175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:00.322884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:00.323858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:00.324769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:00.324769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:00.324769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:00.324769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:00.329722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 346/690] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:00.330984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.437663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897148-8f88-4828-8a73-d40a878fc525 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.471665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.472328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.472604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.472880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.473596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:00.473898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.474207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87175635-87b2-4d1f-b347-b37d5411c427 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.475258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.491461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 347/691] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:00.492707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.521289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.522014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.522297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.522576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.544851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.546876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:00.569896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:00.572052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:00.574205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:00.574205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:00.574205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:00.574205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:00.574205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 345/692] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:00.579739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.591207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575a1c0-4451-478a-9abb-062db1450b0f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.625657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.626442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.626721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.626996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.634392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.635852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:00.650424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:00.652654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:00.655069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:00.660782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 348/693] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:00.660782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.727887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09d20a-66fa-4281-bc64-08376f998a77 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.770030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0675e2-ac95-491c-b215-6bc06cb6e0cf None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:00.780472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.781084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.781369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.781648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.782388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:00.782696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.784141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.802209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 346/694] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:00.805513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:00.806180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:00.806611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:00.806884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:00.807447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.807749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:00.808052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:00.809478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:00.833351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 349/695] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:00.834592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:00.990686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d9d31-3642-4e20-96ad-81fac08afd65 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.007719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06405feb-c8c4-4751-8d2e-7d79974abed3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.028704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.029774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.030055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.030910 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.038764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.040427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.049007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.049985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.050480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.050963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4ee1eed7-dcbf-4f1c-8b21-d960cfe8224d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:01.057209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:01.058090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:01.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 347/696] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:01.061033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb61f0c-64cd-40ba-b154-182a9bbd4d24 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.061033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb61f0c-64cd-40ba-b154-182a9bbd4d24 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.061033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb61f0c-64cd-40ba-b154-182a9bbd4d24 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.062352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 348/697] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:01.063876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb61f0c-64cd-40ba-b154-182a9bbd4d24 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.144158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.146259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.192363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb61f0c-64cd-40ba-b154-182a9bbd4d24 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.232186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.233853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.234206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.234543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.235772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:01.236146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.238264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a4a01-204b-4300-9093-b6ab9c729bde None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.254095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 349/698] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:01.255698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.256291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.256582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.263044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 350/699] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 03 22:29:01.266460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.282573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:01.284396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:01.367715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 350/700] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:29:01.368618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.383548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87200e4-0f77-4c30-858a-bbb7b40f501a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.428446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.429255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.430001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.430359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.431559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=f7b72281fc3f423094ed8df450d84db7) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:01.431976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.433659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.441540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 351/701] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/role_assignments?user.id=f7b72281fc3f423094ed8df450d84db7&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:01.442595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.491140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0990-20b2-48b4-a030-ee20215da75e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.526998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.527830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.528105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.528371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.539906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.541340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:01.559996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:01.561767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:01.563679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:01.563679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:01.563679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:01.563679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:01.566120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4636d-7d73-462a-a664-3e92106c9f0c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.566315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 351/702] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:01.567648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.602314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.603323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.604523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.604816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.617844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.619770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:01.644515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:01.648665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:01.649777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:01.649777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:01.649777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:01.649777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:01.649777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 352/703] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:01.655463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.677800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919142b-4947-4766-a391-4bafcfdeea60 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.725460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.726141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.726422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.726692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.727433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:01.727810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.729262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.746469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 352/704] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:01.747874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.775107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f9d8-1f64-4404-87a4-279eb9c143a7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.823340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.823970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.824252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.824531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.825261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:01.825569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.827062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.840546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 353/705] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:01.848566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.857849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac90e6-c31f-41a3-8e78-125075c6a6f6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:01.901534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:01.902339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.902969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.903286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.912540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:01.914011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a2b5ec24-87a3-49b4-8cdf-aebdc0e8ddd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:01.931575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:01.934473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:01.938714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 353/706] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:01.939892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124158b2-0da4-4362-8ca9-f6aa88ebdf8a None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:01.940398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124158b2-0da4-4362-8ca9-f6aa88ebdf8a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:01.940398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124158b2-0da4-4362-8ca9-f6aa88ebdf8a None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:01.941687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 354/707] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:01.945700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124158b2-0da4-4362-8ca9-f6aa88ebdf8a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:01.974817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f39e8-0db1-4bd6-aa53-96a7f2b58fd9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.016117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f373853-d215-44d0-ba95-faf3e4e60386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.016796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f373853-d215-44d0-ba95-faf3e4e60386 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.017081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f373853-d215-44d0-ba95-faf3e4e60386 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.017358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f373853-d215-44d0-ba95-faf3e4e60386 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.018082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f373853-d215-44d0-ba95-faf3e4e60386 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.019516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f373853-d215-44d0-ba95-faf3e4e60386 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.060231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124158b2-0da4-4362-8ca9-f6aa88ebdf8a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.112562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 354/708] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:29:01 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:02.113881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.114173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.114453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.154215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:02.155591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:02.244107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.245388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.245876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.246404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.247733 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:02.248290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.250714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.268636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 355/709] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:02.274610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:02.322408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 355/710] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:29:02.378322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:02.429648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5565d7-a47a-4198-b120-a54f13a00051 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.473827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.474835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.474835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.475005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.475901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=6d0846a688aa48a9a69fcb730dc5d7f5) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:02.476214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.477652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf3555-6ca2-4ab3-8227-a2eae869889e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.486884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 356/711] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/role_assignments?user.id=6d0846a688aa48a9a69fcb730dc5d7f5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:02.488218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173e61-6a59-4297-b7a1-c1446c0ea159 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.488489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173e61-6a59-4297-b7a1-c1446c0ea159 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.488767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d173e61-6a59-4297-b7a1-c1446c0ea159 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.490319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 357/712] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:02.495984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.496279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.496563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.501532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec0c6-aeec-4aff-b95d-ca1aec64344c None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.515170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:02.517012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:02.540903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.541972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.542402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.542851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] PATH_INFO: `/v3/services/network` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.543703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.545283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:02.560727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:02.562113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:02.563093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:02.565605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 356/713] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:02.571713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:02.591269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 358/714] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:29:02.614182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:02.680639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69adb1-ebad-4e88-bfe6-20d02dc6876c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.722128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e78f4-87ca-4755-a2e8-f6dfb0067b0d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.752079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.752745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.753024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.753299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.754009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] RBAC: Adding query filter params (name=network) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:02.754313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.755722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.760841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 357/715] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:02.763137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.764237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.765061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.765339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.766000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.767373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.767784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:02.788129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:02.789125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:02.790382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 359/716] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:02.795950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:02.907087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc016b3-1b4e-4790-90f4-4aebe36bf67c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:02.944720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:02.945597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:02.945888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:02.946167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:02.946889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:02.947199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:02.948625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:02.954677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 360/717] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:02.960488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:03.009573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac26b-8630-45aa-b106-b15acbe8890d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:03.073014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720e818-f843-45c7-a67b-32856b054cfa None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:03.090551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:03.091226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:03.091504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:03.091797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:03.092617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] RBAC: Adding query filter params (type=network) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:03.092951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:03.094348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33cf21-91b7-4a4e-b4a5-670bd7d84aec None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:03.106897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 358/718] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:03.108902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:03.109560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:03.109834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:03.110099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:03.110801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:03.111101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:03.112556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486b9bf-8092-4340-a041-48923f263298 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:03.119249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 361/719] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 22:29:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:04.362089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663229c-e488-4ab5-a21c-6754d620212a None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:04.362654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663229c-e488-4ab5-a21c-6754d620212a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:04.362654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663229c-e488-4ab5-a21c-6754d620212a None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:04.364285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 359/720] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:04.369567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:04.370375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:04.370862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:04.396556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:04.398050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:04.476783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 362/721] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:29:04.512839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663229c-e488-4ab5-a21c-6754d620212a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:04.768415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663229c-e488-4ab5-a21c-6754d620212a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:04.806611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:04.807393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:04.807691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:04.807965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:04.821675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:04.829772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:04.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:04.831811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:04.835929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 360/722] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:04.837026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:04.958274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d9e2-61ce-41bb-b8ed-3326293729d7 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:04.997268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:04.997941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:04.998227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:04.998504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:04.999290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:04.999596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:05.000982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:05.012758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 363/723] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:05.019246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.121222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f530c-d8fa-4558-b7fb-f016b09b291e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:05.159073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:05.159941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.160217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.160485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.172874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:05.174326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:05.201309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:05.202846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:05.203808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:05.203808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:05.203808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:05.203808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:05.203808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 361/724] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:05.208917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.350701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83cc5-4948-4c86-9236-109b724945bc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:05.401222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:05.402037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.402207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.402415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.403142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:05.403446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:05.404899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e01d9-6db0-426c-a34b-84955d1c071b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:05.420698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 364/725] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:05.426094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.439638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a7281-17e5-4c7c-9fa2-1ff03e41a555 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.439913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a7281-17e5-4c7c-9fa2-1ff03e41a555 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.440188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a7281-17e5-4c7c-9fa2-1ff03e41a555 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.444062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 365/726] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:05.448907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021844c2-9ac0-4fbb-9353-c2fd048d9d5f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.449184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021844c2-9ac0-4fbb-9353-c2fd048d9d5f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.449454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021844c2-9ac0-4fbb-9353-c2fd048d9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.475859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-021844c2-9ac0-4fbb-9353-c2fd048d9d5f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:05.477064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-021844c2-9ac0-4fbb-9353-c2fd048d9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:05.545522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbc18c-cd71-455e-a2e0-853208cbec6f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:05.551708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 366/727] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:29:05.553168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60426b94-3004-482d-b557-1fdff6197f2d None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.553462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60426b94-3004-482d-b557-1fdff6197f2d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.553743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60426b94-3004-482d-b557-1fdff6197f2d None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.555394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 367/728] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:05.575250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.575588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.575836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.587920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:05.587920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.587920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.587920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.595911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:05.597591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:05.598135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:05.599323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:05.616318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:05.617481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 22:29:05.618657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:05.620898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 362/729] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:05.621823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.679721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 368/730] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 03 22:29:05.680645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.737953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20b8f0-af22-4128-bf5c-c4066e286c12 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:05.775549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:05.776627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.777089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.777507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.788984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:05.797328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:05.798478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:05.799494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:05.800184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c643f7-6705-48b6-addf-21cd53a12b67 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:05.801880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 363/731] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:05.802816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.839848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:05.840533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.840817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.841094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.841939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:05.842251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:05.846467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:05.875715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 369/732] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:05.875715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.914610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbc87f-5b30-4ea0-928f-d768576ac576 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:05.947218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dbe97-b52e-409b-8a3d-baf198ad6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:05.948042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dbe97-b52e-409b-8a3d-baf198ad6542 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.948309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dbe97-b52e-409b-8a3d-baf198ad6542 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.948577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dbe97-b52e-409b-8a3d-baf198ad6542 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.958824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dbe97-b52e-409b-8a3d-baf198ad6542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-512dbe97-b52e-409b-8a3d-baf198ad6542 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:05.966514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:05.967533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 364/733] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:05.973388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12690482-cc14-4c8a-a8a2-e72b49e09684 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:05.974715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12690482-cc14-4c8a-a8a2-e72b49e09684 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:05.974715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12690482-cc14-4c8a-a8a2-e72b49e09684 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:05.974715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 365/734] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:05.974715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12690482-cc14-4c8a-a8a2-e72b49e09684 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:05.981067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56243d-4f64-4a1d-acdf-bfaca4cf76b7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.014750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.015417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.015730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.016012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.016760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:06.017068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.018420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb115c-9e92-4aeb-8ff8-0337b58e621b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.026203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 370/735] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:06.027406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f0f5-f74e-4a3d-843f-19bd67fa77c3 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.027722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f0f5-f74e-4a3d-843f-19bd67fa77c3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.027986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f0f5-f74e-4a3d-843f-19bd67fa77c3 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.029329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 371/736] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:06.032366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f0f5-f74e-4a3d-843f-19bd67fa77c3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.073036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12690482-cc14-4c8a-a8a2-e72b49e09684 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.103667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816a341-2c51-40fd-9ca2-06feeb5cc4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.104299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a341-2c51-40fd-9ca2-06feeb5cc4fd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.104575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a341-2c51-40fd-9ca2-06feeb5cc4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.104845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a341-2c51-40fd-9ca2-06feeb5cc4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.127977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f0f5-f74e-4a3d-843f-19bd67fa77c3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.159868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.160514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.160797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.161074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.161815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:06.162120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.163483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78388c-1e8e-43ca-aa5f-015dc347e610 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.167522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a341-2c51-40fd-9ca2-06feeb5cc4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.168957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a341-2c51-40fd-9ca2-06feeb5cc4fd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.171970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 372/737] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:06.172952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.173235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.173534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.188943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:06.190111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:06.258296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 373/738] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:29:06.259142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.274457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 366/739] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 03 22:29:06.274457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.274457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.274457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.289299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:06.290493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:06.352600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 367/740] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 03 22:29:06.353416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.361459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44453f00-b57f-4295-9827-b09de76e36cd None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.393699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.394417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.394699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.394978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.404542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.406520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:06.424060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:06.425129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:06.426226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:06.426226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:06.426226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:06.426226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:06.426226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 374/741] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:06.426226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.447299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7c15-4f71-4910-8441-f8e13202a2b7 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.479085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.479970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.480253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.480533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.490269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.491731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:06.508977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:06.510075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:06.511151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:06.511151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:06.511151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:06.511151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:06.511151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 368/742] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:06.511151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.525415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569660-9c97-400c-ac1c-42fcc64919ba None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.557494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.558284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.558566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.558838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.569585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.571020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:06.587164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:06.588242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:06.593946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:06.593946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:06.593946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:06.593946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:06.593946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 375/743] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:06.593946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.605219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506464e-3e33-4e1e-950b-272adc0b1d91 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.638751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.649227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.649227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.649227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.649227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.649227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.686972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9102645-412f-4e21-a3d4-ef99965623ef None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.717810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.718486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.718767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.719042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.719775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.721125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.779430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 369/744] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:06 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:06.780280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.813297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 376/745] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:06 2022] POST /identity/v3/services => generated 240 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:06.814537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.913617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e65e1f-02d4-41e0-8b7f-c27a5eda185b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.937998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd8e7d-a3f1-4f5e-9c64-6befa297e317 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:06.952762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.953841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.954350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.954856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.955852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:06.956510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.958204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:06.972953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 370/746] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:06.974164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:06.987783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:06.988467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:06.988748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:06.989018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:06.989760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:06.990064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:06.991479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.007188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 377/747] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:07.008578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.098460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95191c-9b2f-4445-8276-8cada342c232 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.114885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8604c5-3740-4f54-8028-c307d4ee0941 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.132747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.133408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.133709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.133965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.134689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:07.134994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.136385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.150007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.150565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 371/748] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:07.150794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.151079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.151351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.151450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.164518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.165936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:07.182408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:07.183392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 378/749] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:07.185025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.258324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d837a7-30a7-4445-99f4-b750c47a5c3e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.295135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.299627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.299627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.299627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.307629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f7629-b607-44e0-af7b-146809af7c3f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.307854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.307854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:07.331998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:07.334211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:07.339865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:07.341341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 372/750] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:07.341341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.363627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.363627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.364101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.364247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.375623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.375623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:07.387627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:07.390577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 379/751] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:07.391683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.463885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b9197-1db8-41e1-8546-aa2908972814 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.498928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.499599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.499902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.500177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.501014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:07.501322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.502752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.521529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 373/752] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:07.522454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.533650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21725ebe-9ee4-49ba-8f56-f667662ff405 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.609991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.610678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.610955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.611226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.612094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:07.612404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.613842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.634077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad57f5-c998-46a2-8a42-d15fe8782918 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.657104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 380/753] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:07.658083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.669539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.670458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.671317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.671594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.672429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:07.672739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.674188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.689933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 374/754] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:07.691083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.783545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f6869-5381-4b75-815d-1741a992088c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.799163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7a61b-a5be-474b-b21c-9914d5a67a0e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:07.818052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.818843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.819121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.819392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.832601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.833040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:07.833617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:07.833900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:07.834121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:07.834235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:07.855631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:07.857034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:07.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:07.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:07.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:07.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:07.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 381/755] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:07.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:07.951461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:07.955630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.032808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19ace1-b861-4349-b991-c773a4ab7863 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.066608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.067247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.067542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.067864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.068743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=f7b72281fc3f423094ed8df450d84db7) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:08.069171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.070466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.079980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 382/756] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/role_assignments?user.id=f7b72281fc3f423094ed8df450d84db7&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:08.080875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.087067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 375/757] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:08.094463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.209071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de9ee1-a93b-4b5c-ad24-7afcc9dace93 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.248540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.249777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.250277 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.250768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.263374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.266149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:08.287540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:08.288557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:08.289455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:08.289455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:08.289455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:08.289455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:08.296641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 376/758] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:08.298471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.345615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4f01-a0e0-4b3a-b2a6-5530a46a8fbd None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.395529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.396232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.396517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.396799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.397530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:08.398277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.399694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.414305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 383/759] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:08.424589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.437476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ae951-06af-4120-bbfc-680622c6fefc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.471679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.472336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.475624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.475624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.475624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:08.475624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.475624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.504418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 377/760] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:08.510303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.582150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a1dd9-ace0-4107-85bf-27110a136d97 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.630971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.631749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.632029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.632303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.643015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.644508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.649990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cde149-2ba5-4192-8761-7c027d1db844 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:08.664036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:08.666109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:08.668088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 384/761] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:08.676930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.682925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.683749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.684026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.684299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.699800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.701325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:08.725497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:08.727380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:08.729261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 378/762] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:08.735708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.793576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfc71a-f7bc-4a17-97b6-5611a15812d1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.850864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c603a-e153-4bba-aca7-0886e3777e59 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:08.856853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.857518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.857786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.858586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.859407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:08.859743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.861185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.882259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 385/763] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:08.888301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:08.890529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:08.891190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:08.891547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:08.891779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:08.892572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:08.892879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:08.894309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:08.906658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 379/764] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:08.912538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:09.019889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362f125-a88c-467f-9023-351be84fcca2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:09.056777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:09.058234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.058517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.058965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.059887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=b8fef1a759164dfcbbf73546063fee79) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:09.060198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:09.062248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b71e8-8e07-4722-b532-e0a80579cb27 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:09.069299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 380/765] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:08 2022] GET /identity/v3/role_assignments?user.id=b8fef1a759164dfcbbf73546063fee79&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:09.105587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b025f-2fb5-4a54-9910-4e73192744a3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:09.149869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cbdb1-9e72-49ca-b335-e3dac74c78a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:09.150694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cbdb1-9e72-49ca-b335-e3dac74c78a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.150976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cbdb1-9e72-49ca-b335-e3dac74c78a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.151253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cbdb1-9e72-49ca-b335-e3dac74c78a1 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/6d0846a688aa48a9a69fcb730dc5d7f5/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.153291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cbdb1-9e72-49ca-b335-e3dac74c78a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=6d0846a688aa48a9a69fcb730dc5d7f5, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:09.154730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cbdb1-9e72-49ca-b335-e3dac74c78a1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:09.232190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 386/766] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:29:08 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/6d0846a688aa48a9a69fcb730dc5d7f5/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:29:09.250647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c673a-acd4-4d5a-8881-2f13e9c1370b None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.250971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c673a-acd4-4d5a-8881-2f13e9c1370b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.251191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c673a-acd4-4d5a-8881-2f13e9c1370b None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.253034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 381/767] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:09.259076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55712b-51ae-4b84-873f-106cb80d1191 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.259368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55712b-51ae-4b84-873f-106cb80d1191 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.259674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55712b-51ae-4b84-873f-106cb80d1191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.281687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8a55712b-51ae-4b84-873f-106cb80d1191 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:09.283064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8a55712b-51ae-4b84-873f-106cb80d1191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:09.378449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 387/768] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:09.422192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c673a-acd4-4d5a-8881-2f13e9c1370b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:09.543404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740a63-8c64-4b17-a7f5-0bc97a649390 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.543769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740a63-8c64-4b17-a7f5-0bc97a649390 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.544052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740a63-8c64-4b17-a7f5-0bc97a649390 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.545657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 388/769] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:09.547351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c673a-acd4-4d5a-8881-2f13e9c1370b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:09.552173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.552628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.552825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.576542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:09.578064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:09.593387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512a68-7e88-4625-8013-607a766570cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:09.594605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512a68-7e88-4625-8013-607a766570cb None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.595084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512a68-7e88-4625-8013-607a766570cb None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.595552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512a68-7e88-4625-8013-607a766570cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.596483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512a68-7e88-4625-8013-607a766570cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:09.598102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512a68-7e88-4625-8013-607a766570cb None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-50512a68-7e88-4625-8013-607a766570cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:09.611014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:09.612091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:09.612942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:09.619093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 382/770] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 3 22:29:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:09.623043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512a68-7e88-4625-8013-607a766570cb None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:09.691303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 389/771] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:09.725602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:09.782215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512a68-7e88-4625-8013-607a766570cb None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:09.846455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:09.847119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.847404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.847698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.848406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:09.848712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:09.850072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:09.861416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 383/772] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 22:29:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:09.868618 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:09.905589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54acbe0-de70-4de1-a00f-122862c6569d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:09.984892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:09.985702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:09.985983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:09.986254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:09.986915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:09.988348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.007525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115a271-d801-4490-ba19-4d691212f53a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:10.020000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:10.021199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:10.022699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 390/773] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:09 2022] GET /identity/v3/services/network => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:10.027181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:10.041803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.042519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.042799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.043071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.043850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:10.044155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.045516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.050995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 384/774] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 22:29:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.057905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:10.161343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc83d4-be25-415e-8813-b0747c6c18b0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.220767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.221820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.222352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.222828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.223955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] RBAC: Adding query filter params (name=network) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:10.224476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.226260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.232104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 391/775] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.241988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:10.262028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9a66a-02d3-427f-86fc-1a046b939550 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.321763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.322421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.322695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.322962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.323779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] RBAC: Adding query filter params (interface=public, service_id=8ec862c1a38d41d39ce89220feef7cba, region_id=RegionOne) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:10.324088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.325448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.340402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 385/776] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/endpoints?service_id=8ec862c1a38d41d39ce89220feef7cba&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.345270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:10.397223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c448c1-afec-4388-b34e-cf31f8637a5d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.430594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.431260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.431539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.431840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.432547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:10.432847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.434221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.440242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 392/777] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.445658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:10.545246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1a0b1-62cb-4fe5-928e-19f926774bd6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.560182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde58dc-22ee-4b5a-8089-b121739691d4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.582305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.582981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.583261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.583535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.584383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] RBAC: Adding query filter params (interface=public, service_id=4cf0cf20ebed49d49f34f015d35f8a8d, region_id=RegionOne) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:10.584693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.586109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.594569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 393/778] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/endpoints?service_id=4cf0cf20ebed49d49f34f015d35f8a8d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.599726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:10.647059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8616b56-0fef-4111-b44e-65d1bfd3e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.647760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616b56-0fef-4111-b44e-65d1bfd3e8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.648218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616b56-0fef-4111-b44e-65d1bfd3e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.648499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616b56-0fef-4111-b44e-65d1bfd3e8f0 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.649191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616b56-0fef-4111-b44e-65d1bfd3e8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.650551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616b56-0fef-4111-b44e-65d1bfd3e8f0 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.670506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 386/779] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/services => generated 772 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.700050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09056f6f-8616-4fd7-8ccf-ead5212be94b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:10.736218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63772dc8-d2fa-4071-a1a8-ee0b4e091262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:10.736890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772dc8-d2fa-4071-a1a8-ee0b4e091262 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.737175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772dc8-d2fa-4071-a1a8-ee0b4e091262 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.737444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63772dc8-d2fa-4071-a1a8-ee0b4e091262 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.738132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63772dc8-d2fa-4071-a1a8-ee0b4e091262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:10.739513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63772dc8-d2fa-4071-a1a8-ee0b4e091262 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:10.745575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 394/780] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/services => generated 772 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:10.751706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1f7c-c857-4086-a18b-eca116e59e46 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.752080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1f7c-c857-4086-a18b-eca116e59e46 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.752274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d1f7c-c857-4086-a18b-eca116e59e46 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.753996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 387/781] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:10.759920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:10.760246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:10.760479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:10.779029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:10.780838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:10.859991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 395/782] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:10.895169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1f7c-c857-4086-a18b-eca116e59e46 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:11.024659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d1f7c-c857-4086-a18b-eca116e59e46 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:11.057888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:11.058674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.058948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.059220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.069271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:11.077441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:11.078401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:11.079244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 388/783] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:11.084591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:11.201323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7242b-7272-4598-87d5-a55ad90c52ab None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:11.246147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:11.247212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.247721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.248217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.249220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:11.249722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:11.251293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:11.263295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 396/784] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:11.269652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:11.388883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690dc1f-dda9-4735-aa96-8c81b0bf9240 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:11.430370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6191-5fba-400d-b656-a896389defda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:11.431155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6191-5fba-400d-b656-a896389defda None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.431434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6191-5fba-400d-b656-a896389defda None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.431730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a6191-5fba-400d-b656-a896389defda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.451411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a6191-5fba-400d-b656-a896389defda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:11.453470 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a6191-5fba-400d-b656-a896389defda None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e45a6191-5fba-400d-b656-a896389defda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:11.470873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:11.471847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:11.472751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:11.472751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:11.472751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:11.472751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:11.472751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 389/785] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:11.477839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:11.616726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb501130-f556-444b-9018-ae9ad4c0a463 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:11.664413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:11.665549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.666082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.666581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.667519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:11.668059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:11.669650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140b038-1df8-4ab7-bfb9-26d0744ce434 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:11.685325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 397/786] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:11.691213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6191-5fba-400d-b656-a896389defda None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:11.837817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a6191-5fba-400d-b656-a896389defda None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:11.884320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:11.885123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.885411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.885687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.895376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:11.896861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:11.908081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d23b-422a-4288-b455-215604d130eb None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.908998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d23b-422a-4288-b455-215604d130eb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.909478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d23b-422a-4288-b455-215604d130eb None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.911276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 398/787] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:11.914504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:11.915493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 22:29:11.916474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:11.917089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:11.917174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 390/788] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:11.917246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:11.917246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:11.921274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:11.945413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:11.946585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:12.024678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6bb9-0271-4147-a174-474e82fa8f12 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.065283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.065956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.066234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.066503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.067342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:12.067667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.069100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.090459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 391/789] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 22:29:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:12.100594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.114224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 399/790] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:12.148623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.200926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1f80d-6dcc-47d8-b44e-d9e854902e28 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.241133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.242288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.242795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.243285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.253748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.255456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-3539884c-8920-4a2a-bd3d-bb0ee8dec399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:12.273305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:12.274245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:12.275137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:12.275137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:12.275137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:12.275137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:12.277440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 392/791] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:12.279048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c670f0b-e270-4883-bd5f-5a29bdb3da0d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.279550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c670f0b-e270-4883-bd5f-5a29bdb3da0d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.280619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c670f0b-e270-4883-bd5f-5a29bdb3da0d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.282603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 393/792] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:12.283664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c670f0b-e270-4883-bd5f-5a29bdb3da0d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.286270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37788f0-4391-4cfc-82f3-6ebdd557e25c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.328622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1ab01-a538-4ad3-8faa-5a18259e2078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.329474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ab01-a538-4ad3-8faa-5a18259e2078 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.329760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ab01-a538-4ad3-8faa-5a18259e2078 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.330037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1ab01-a538-4ad3-8faa-5a18259e2078 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.340902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1ab01-a538-4ad3-8faa-5a18259e2078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-b6a1ab01-a538-4ad3-8faa-5a18259e2078 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:12.348734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:12.349665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:12.350490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 400/793] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:12.351738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.351738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.352057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.369813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:12.371064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:12.393555 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c670f0b-e270-4883-bd5f-5a29bdb3da0d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.427113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.428100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.428588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.429088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.430021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:12.430527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.432181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.443872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 401/794] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:12.444524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 394/795] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:12.444793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.451653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.573501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675b428-6b87-4522-8e01-9aede3c24d1b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.574656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2059b-bb72-4d49-b7e8-0ab24000f062 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.608893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.609651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.610104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.610528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.610663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.611005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.611209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.611513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.612416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:12.612821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.614512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.618741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.620343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.623061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 402/796] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:12.624560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:12.636280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:12.637338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:12.638288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:12.645547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 395/797] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:12.646366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.726497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6023d3b-d320-4734-8896-92d02e528b0f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.750072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc87eb7c-cd25-40c6-b63c-d8a935f5c934 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.761934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.762936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.763049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.763323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.774211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:12.783346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:12.784531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:12.785646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:12.789497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 403/798] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:12.790339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.790919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.791946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.792421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.792881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.804247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.805947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:12.823996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:12.824945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:12.825871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:12.825871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:12.825871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:12.825871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:12.828679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 396/799] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:12.829702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.896233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5015c0e-3b3e-490c-a38e-8596886c92fa None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.930123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.930763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.931123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.931396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.932228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:12.932541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.933935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e35679-48a2-4e72-a385-c7b3cd1857c1 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:12.934063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.951642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 404/800] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:12.951642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:12.975399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:12.976306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:12.976768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:12.977222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:12.978181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:12.978663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:12.980258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:12.989657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 397/801] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:12.990684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.064680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac700d-587e-4fdd-a295-dc37841d95c8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.090532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671c563-10a3-4c83-b1f3-b1a686cffbd3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.099626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.100308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.100651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.100934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.101889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:13.102000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.103484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.115553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 405/802] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:13.116616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.127843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be219554-81fe-4931-948e-33007194323a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.129094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be219554-81fe-4931-948e-33007194323a None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.129556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be219554-81fe-4931-948e-33007194323a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.130028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be219554-81fe-4931-948e-33007194323a None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/f7b72281fc3f423094ed8df450d84db7/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.132301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be219554-81fe-4931-948e-33007194323a None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=f7b72281fc3f423094ed8df450d84db7, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.133962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be219554-81fe-4931-948e-33007194323a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.211751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 398/803] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:29:12 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/f7b72281fc3f423094ed8df450d84db7/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:29:13.216813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be219554-81fe-4931-948e-33007194323a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.222764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12ddf0-22d4-4970-b64c-612538c4886a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.268777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.269616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.269949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.270232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.285280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.287447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:13.309431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:13.310407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:13.311905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:13.311905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:13.311905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:13.311905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:13.311905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 406/804] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:13.318392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.439916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef3d57-e191-468f-822a-819e04c1cba8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.479028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.479635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.479956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.480235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.480978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:13.481285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.482676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a61ab-c4fb-4dcc-8af8-8d11eeb9ec26 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.484018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be219554-81fe-4931-948e-33007194323a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.497883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 407/805] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:13.498447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6b131-22eb-4f72-bc21-0b518c2df879 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.498796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6b131-22eb-4f72-bc21-0b518c2df879 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.499074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6b131-22eb-4f72-bc21-0b518c2df879 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.504956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 408/806] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:13.506195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0b7bd-10c0-48c7-895a-92c9a6c98157 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.506484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0b7bd-10c0-48c7-895a-92c9a6c98157 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.506762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0b7bd-10c0-48c7-895a-92c9a6c98157 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.508296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 409/807] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:13.509327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0b7bd-10c0-48c7-895a-92c9a6c98157 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.527750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.528675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.529024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.529388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.537310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.538740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-95f33e9d-2056-4715-b9f3-ff55a6564795 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:13.553592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:13.554756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:13.556006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 399/808] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:13.560571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b58ea-9ff2-47e5-bedc-ff7ffc620ce7 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.560874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b58ea-9ff2-47e5-bedc-ff7ffc620ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.561207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b58ea-9ff2-47e5-bedc-ff7ffc620ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.579168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-376b58ea-9ff2-47e5-bedc-ff7ffc620ce7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:13.580365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-376b58ea-9ff2-47e5-bedc-ff7ffc620ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:13.617028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0b7bd-10c0-48c7-895a-92c9a6c98157 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.647567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 400/809] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:13.653232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.653720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.653965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.654513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.654724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.654824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.655084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.663399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.664906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.674983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:13.676463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:13.679732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:13.680671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:13.681604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:13.685633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 410/810] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:13.687121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.743773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 401/811] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:13.744319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.796551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42691dad-19f7-4dfd-96ac-144250e73fa5 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.830411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.831171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.831453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.831795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.832622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:13.832927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.834334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.845349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2afee-f515-4436-b41c-876b7489d906 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:13.851765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 411/812] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:13.852796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.879789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:13.880572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:13.880849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:13.881119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] PATH_INFO: `/v3/services/network` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:13.881767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:13.883119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:13.895218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:13.896272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:13.897114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 402/813] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/services/network => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:13.897961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:13.980524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15189e-2e89-4351-b11b-be7bbd7411e3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.014024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.015463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.015768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.016038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.016875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:14.017183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.018098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140ddab-ad0a-4c0c-8c11-c11cc56aed01 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.018609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.040452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 412/814] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:14.040452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.057562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.058457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.058739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.059009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.059694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.061060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:14.073449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:14.074391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:14.075293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 403/815] 10.222.0.23 () {56 vars in 1129 bytes} [Tue May 3 22:29:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:14.076755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.139828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4a1af-80de-414e-bfef-49268d35d9b6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.170358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce5ba-114d-4b19-a3c4-4a9046718c7c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.180012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.181315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.181761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.182182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.192901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.194533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.203064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.203752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.204035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.204312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.205017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] RBAC: Adding query filter params (name=network) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:14.205323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.206676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.210944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 404/816] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:14.211745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:14.213986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:14.215045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:14.216150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:14.216150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:14.216150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:14.216150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:14.221328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 413/817] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:14.221328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.311217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a342-1b3c-4a80-bdee-7b0ad0b6f297 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.318601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3971b5e-85fe-4b63-b35c-394620db6798 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.346093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.346743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.347031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.347300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.361809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.362565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.362849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.363125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.363865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:14.364178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.365553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.370149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 414/818] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:14.370790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.419238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.420743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.469723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde0223-8cd8-4cc4-a802-7b8059790e78 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.503185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.503878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.504162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.504438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.505150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:14.505460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.506825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.512006 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 415/819] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:14.512324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.526594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 405/820] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:14.526594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.610702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42075-1316-4000-a552-eb7b6372a6b4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.619498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88d434-891f-4e3b-bd07-62f76b98ca9c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.645877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.646395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.646682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.646960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.647721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:14.650588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.650588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.653185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.653837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.654119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.654391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.655124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:14.655431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.656796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.665469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 416/821] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:14.665469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.666075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 406/822] 10.222.0.23 () {56 vars in 1124 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:14.666859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.762054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736e8c6-2714-49d1-8b92-0dba12c1e02d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.762397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8a222-91bd-48c4-9c4b-7990e88dc9a8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.794700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.796026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.796313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.796585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.796872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.797528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.797813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.798087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.798829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.800285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.806557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.808015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:14.826064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:14.827150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:14.828162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:14.828162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:14.828162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:14.828162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:14.828162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 407/823] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:14.828468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.887001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 417/824] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:14.888171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:14.930326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122e8f1-dde3-4af1-8b82-94305fe5f803 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:14.973895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:14.974707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:14.975045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:14.975252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:14.982898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:14.984974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:15.005374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:15.006368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:15.007275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 408/825] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:15.007798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.023905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c0749-6920-4997-9a3c-0d5748094c7a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.061984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.062960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.063386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.063870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.064781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.066416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.118571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3152d-b618-49de-b847-2a58e821b2e9 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.154753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.155930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.156216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.156494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.157233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:15.157540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.158922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.160456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 418/826] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:15.161474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.172825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 409/827] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:15.180808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.298172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a59b5-9c4f-407c-b5fb-61e036bce791 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.313516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bf239-9bf8-4b64-bbb6-08b5c79e800f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.343555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.344855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.345145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.345424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.346416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:15.346743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.348885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.352406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.353602 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.354036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.354524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.362891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 419/828] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:15.368558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.369167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.370659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:15.394595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:15.395560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:15.396575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:15.397797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 410/829] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:15.404724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.493274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527460-246d-48c4-8e66-9549fab1f983 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.523890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d61205-5d0e-400d-afb9-c98e07b1bb12 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.528413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07922a65-1393-4614-be29-57c8cf50c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.529307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07922a65-1393-4614-be29-57c8cf50c6f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.529582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07922a65-1393-4614-be29-57c8cf50c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.529880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07922a65-1393-4614-be29-57c8cf50c6f8 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/b8fef1a759164dfcbbf73546063fee79/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.544412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07922a65-1393-4614-be29-57c8cf50c6f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=b8fef1a759164dfcbbf73546063fee79, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.546384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07922a65-1393-4614-be29-57c8cf50c6f8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.559371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.560059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.560342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.560622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.561974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:15.562285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.563734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.575438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 411/830] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:15.581325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.635179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 420/831] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:29:15 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/b8fef1a759164dfcbbf73546063fee79/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:29:15.636659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a3d05-4af5-4c18-9b48-7c8e7978a659 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.636946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a3d05-4af5-4c18-9b48-7c8e7978a659 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.637214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a3d05-4af5-4c18-9b48-7c8e7978a659 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.654273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 421/832] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:15.655768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.656058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.656459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.687552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f68aa-88b8-4ecb-8ac8-7547d91b74da None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.693168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:15.697713 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:15.725422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.726092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.726371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.726709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.727559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=6d0846a688aa48a9a69fcb730dc5d7f5) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:15.727935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:15.729384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:15.736988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 412/833] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/role_assignments?user.id=6d0846a688aa48a9a69fcb730dc5d7f5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:15.779969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 422/834] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:15.804520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:15.917603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85757a4b-8445-4e8d-ac6b-f0557ca10abf None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:15.955476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:15.956316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:15.956579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:15.956851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:15.968135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:15.975796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:15.976741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:15.978444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 413/835] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:15.983091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:16.087120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232aa0-6339-4230-a999-a094a2c6c686 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:16.120455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:16.121134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:16.121417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:16.121692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:16.122449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:16.122760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:16.124711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:16.133546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 423/836] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:16.138827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:16.244080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec0fbf-eea9-4e91-aed4-c3dd24e6646e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:16.277697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:16.278487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:16.278819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:16.279094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:16.289798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:16.291233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:16.308536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:16.310596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:16.312835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:16.312835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:16.312835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:16.312835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:16.312835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 414/837] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:16.315692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:16.417405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaac958-9833-4333-9407-6ff8c99e7fbd None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:16.453449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:16.454115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:16.454399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:16.454673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:16.455396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:16.455727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:16.457105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:16.470130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 424/838] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:16.475297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:16.582064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493f69-5902-46c6-95bb-e527fd0a095b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:16.615506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95055933-500b-418c-8102-38b9f78a689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:16.616324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95055933-500b-418c-8102-38b9f78a689a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:16.616604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95055933-500b-418c-8102-38b9f78a689a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:16.616881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95055933-500b-418c-8102-38b9f78a689a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:16.624480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95055933-500b-418c-8102-38b9f78a689a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:16.625980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95055933-500b-418c-8102-38b9f78a689a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-95055933-500b-418c-8102-38b9f78a689a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:16.640267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:16.642300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:16.644013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 415/839] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:16.653352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:16.745775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbd549-d5cc-4fe5-9450-5f55d5b7d98f None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:16.784575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:16.785241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:16.785523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:16.785797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:16.786630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:16.786936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:16.788385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:16.805919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 425/840] 10.222.0.23 () {56 vars in 1135 bytes} [Tue May 3 22:29:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:16.811687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95055933-500b-418c-8102-38b9f78a689a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:16.913387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95055933-500b-418c-8102-38b9f78a689a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:16.947066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:16.947738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:16.948024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:16.948299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.018748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.020164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.116871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 416/841] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:17.122380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.225228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714851-bd64-41d6-abb2-008e16fd0379 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:17.259108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:17.259937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.260219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.260493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.271307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.272724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:17.290509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:17.291403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:17.292507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:17.292507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:17.292507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:17.292507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:17.292507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 426/842] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:17.297326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.397894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e15b5-199c-4df1-9983-346d7610d627 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:17.436700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:17.437427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.437711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.437987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.438771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:17.439082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.440502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1c9d7-61d9-4f41-b8dc-294d8f02b05b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.452839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 417/843] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:17.458262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.558408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d02f07-dfe9-4291-ae77-4541a8c38144 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:17.597374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:17.598183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fa0e-d7a0-4939-b8e2-b5bafa362fec None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.598320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.598483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fa0e-d7a0-4939-b8e2-b5bafa362fec None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.598579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.598754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fa0e-d7a0-4939-b8e2-b5bafa362fec None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.598853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.600429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 418/844] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:17.605159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.605442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.605718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.608237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.609903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.622830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:17.624581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:17.625109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:17.625985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:17.626861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:17.629086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 427/845] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:17.634660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.712526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 419/846] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:17.738602 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.749036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93153d1-3404-4062-aa60-e1257c860fe3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:17.783295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:17.784148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.784493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.784928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.785783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:17.786156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.787696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.800756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 428/847] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:17.807585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.855648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc983bd-321e-4697-bac2-09161fc76291 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:17.893613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:17.894417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.894691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.894959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.895638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.897027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:17.909120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:17.910164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:17.911027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:17.915151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 420/848] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:17.916418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:17.919353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d69a03-2d9b-4649-a78e-2c559079fdc5 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:17.957508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:17.959063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:17.959798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:17.960288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:17.961439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=f7b72281fc3f423094ed8df450d84db7) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:17.961984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:17.963744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf885-d208-4243-83f7-209ca3918169 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:17.979777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 429/849] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/role_assignments?user.id=f7b72281fc3f423094ed8df450d84db7&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:18.025708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7cf5-5d61-4e85-a3c2-3f9b91e301ec None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.063200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.063891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.064176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.064449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.065166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:18.065469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.066855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.073849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 421/850] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:18.075535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cf551-5281-49fa-82ca-17b7951eb5d4 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.076150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cf551-5281-49fa-82ca-17b7951eb5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.077147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cf551-5281-49fa-82ca-17b7951eb5d4 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.078336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.079025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 430/851] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:18.084467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f729a5-81f0-4f2e-b797-26213353e0c1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.084784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f729a5-81f0-4f2e-b797-26213353e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.085059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f729a5-81f0-4f2e-b797-26213353e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.102925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-23f729a5-81f0-4f2e-b797-26213353e0c1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:18.104471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-23f729a5-81f0-4f2e-b797-26213353e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:18.186967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 431/852] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:18.188256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a12c-fca7-46f5-b3cc-8f343a41d929 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.188537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a12c-fca7-46f5-b3cc-8f343a41d929 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.188809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a12c-fca7-46f5-b3cc-8f343a41d929 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.190187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 432/853] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:18.194872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4690-1b41-4c6b-8c8c-eefe583081ae None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.196611 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.197086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.197426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.216404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:18.218152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:18.235093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.235919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.236736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.236736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.237841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:18.237841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.239239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.249021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 422/854] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:18.254613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.291308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 433/855] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:18.314540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.379038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a79f76-74ef-4246-b9c2-eff0608a092f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.416852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.418426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.419119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.419584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.421767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4b9f9-83a7-4191-89d4-5e0ce0572d0d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.434149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:18.442572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:18.443516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:18.444396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 423/856] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:18.449255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.470295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.471109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.471391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.471692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.472354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.473722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:18.488167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:18.489159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:18.490041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 434/857] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:18.496182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.561889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d0f8-01af-4228-861d-eccaf0a9120f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.595302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84c19c-129f-450f-9e24-c8d4359d9100 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.596633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.597373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.597716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.598061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.598928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:18.599303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.600769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.609374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 424/858] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:18.614691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.630204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.630871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.631517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.631830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.632855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:18.633171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.634819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.641480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 435/859] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:18.646803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.742489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd2160-42da-40fb-9a22-8bf311973652 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.749500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d47d0-ede4-4f24-a24c-bb33a5933246 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.783618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.784298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.784575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.784948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.785389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.785642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:18.785944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.786168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.786448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.786718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.787553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.798801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.799776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 436/860] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:18.800301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:18.818845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:18.819857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:18.820782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:18.820782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:18.820782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:18.820782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:18.820782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 425/861] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:18.826211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:18.939895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b5c9-90af-4ca0-acd0-750562f38972 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:18.979213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:18.980653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:18.980653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:18.980653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:18.981376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:18.981478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:18.982806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:18.998182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 437/862] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:19.003290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:19.108217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8283-e9c0-4f90-bae5-813f4b7356c4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:19.144163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:19.145324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:19.145812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:19.146309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:19.154401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:19.156182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:19.171084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:19.172087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:19.173033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:19.179660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 426/863] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:29:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:19.181445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:19.284153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8e034-ab36-4ea9-93ed-e026ad5dae20 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:19.319174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:19.320194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:19.320700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:19.321175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:19.322200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:19.322707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:19.324367 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:19.341877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 438/864] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 22:29:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:19.347760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:19.474659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bc6c3-93f6-4024-af52-8deae14d2e07 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:19.532843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:19.534451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:19.535233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:19.536029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:19.633776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:19.635228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:19.732936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 427/865] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:19.740396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:19.845194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb795ad-7051-4496-a43a-2653e4ce281e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:19.879448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:19.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:19.881097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:19.881596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:19.892913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:19.894655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:19.912577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:19.913511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:19.914387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:19.914387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:19.914387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:19.914387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:19.916633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 439/866] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:19.921999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.033798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9f12b-b225-41be-9b50-51d11759d904 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:20.068043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:20.068699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.068978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.069252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.069968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:20.070270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:20.071640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:20.083246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 428/867] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:20.088573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.192752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8c293-b83d-42ae-881b-965a09bfbfbc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:20.226976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:20.228092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.228557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.229028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.236531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:20.238200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a4dbd17d-da61-4865-9341-99f29b6e7ff3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:20.252627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:20.253549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:20.254436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:20.256613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 440/868] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:20.262363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.346795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806205-b605-4d5e-aff3-f966f70bc971 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.347311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806205-b605-4d5e-aff3-f966f70bc971 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.347311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6806205-b605-4d5e-aff3-f966f70bc971 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.348979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 441/869] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:20.353982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.354268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.354755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.370630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd44f5-f545-4c5c-b925-e1fabd28e8b0 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:20.379212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:20.380911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:20.414593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:20.415808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.416605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.417340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.418477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:20.418976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:20.421727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:20.437600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 429/870] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:20.442924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.479645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 442/871] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:20.497477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.558004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9355-eb2c-4293-82a2-3002141f7959 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:20.595467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:20.596308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.596681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.597049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.597999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=b8fef1a759164dfcbbf73546063fee79) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:20.598445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:20.599976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:20.604775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc93f67-3da3-4a7d-8682-53c5399e2929 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:20.611630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 430/872] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:20 2022] GET /identity/v3/role_assignments?user.id=b8fef1a759164dfcbbf73546063fee79&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:20.646358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:20.650075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.650075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.650075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.650075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:20.650075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-aba0ced4-8836-461a-9d4d-af7df85ce18a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:20.663289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:20.664483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:20.665355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 443/873] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:20.671476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.761515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f575ca-2ea9-4417-a81b-a2238cb10c95 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.761695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f575ca-2ea9-4417-a81b-a2238cb10c95 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.761976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f575ca-2ea9-4417-a81b-a2238cb10c95 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.769462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 444/874] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:20.772967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.773262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.773524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.787228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0570f-e3d5-41da-b430-f818e481ba3f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:20.792658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:20.793868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:20.823138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:20.823844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:20.824130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:20.824410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:20.825714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:20.825714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:20.827299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:20.832546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 431/875] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:20.841249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.873151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 445/876] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:20.898992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:20.966540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613e0f-8afa-4a46-8644-5f6bf2a893d6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:21.004279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:21.004964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:21.005306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:21.005582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:21.006362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:21.006681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:21.008261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95563cd-512a-4577-87b7-e619c85259d4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:21.013629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 432/877] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:21.023385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b652ab8-1600-4f8f-9924-7e1c3b570ea2 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:21.062214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2693b8-f093-4ee1-878c-3fdb9d74bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:21.075563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2693b8-f093-4ee1-878c-3fdb9d74bc59 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:21.075933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2693b8-f093-4ee1-878c-3fdb9d74bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:21.076142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2693b8-f093-4ee1-878c-3fdb9d74bc59 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:21.077648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2693b8-f093-4ee1-878c-3fdb9d74bc59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:21.079239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2693b8-f093-4ee1-878c-3fdb9d74bc59 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:21.157191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 446/878] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:20 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:29:21.186785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396996a-9902-49ac-8a5a-7a70586f928a None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:21.187133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396996a-9902-49ac-8a5a-7a70586f928a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:21.187399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396996a-9902-49ac-8a5a-7a70586f928a None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:21.189292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 433/879] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:21.194735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39d39-175b-4ca0-b0da-4a574ec669a7 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:21.195042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39d39-175b-4ca0-b0da-4a574ec669a7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:21.195296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b39d39-175b-4ca0-b0da-4a574ec669a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:21.214167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-59b39d39-175b-4ca0-b0da-4a574ec669a7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:21.215373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-59b39d39-175b-4ca0-b0da-4a574ec669a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:21.297661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 447/880] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:21.320046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396996a-9902-49ac-8a5a-7a70586f928a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:21.431797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396996a-9902-49ac-8a5a-7a70586f928a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:21.471956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bec6b-d8a1-4e73-a7ca-a7eb7741fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:21.472622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bec6b-d8a1-4e73-a7ca-a7eb7741fe4b None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:21.472906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bec6b-d8a1-4e73-a7ca-a7eb7741fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:21.473182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bec6b-d8a1-4e73-a7ca-a7eb7741fe4b None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:21.473921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bec6b-d8a1-4e73-a7ca-a7eb7741fe4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:21.475353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bec6b-d8a1-4e73-a7ca-a7eb7741fe4b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:21.568547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 434/881] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:21 2022] POST /identity/v3/services => generated 269 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:23.074038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61832c99-499c-4611-8fbe-04c658335ba0 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.075062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61832c99-499c-4611-8fbe-04c658335ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.075547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61832c99-499c-4611-8fbe-04c658335ba0 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.078037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 448/882] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:23.083414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e9d87-e2b2-4bfd-8a8a-03945e09ce65 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.084291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e9d87-e2b2-4bfd-8a8a-03945e09ce65 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.084765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e9d87-e2b2-4bfd-8a8a-03945e09ce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.102232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5a7e9d87-e2b2-4bfd-8a8a-03945e09ce65 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:23.103760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5a7e9d87-e2b2-4bfd-8a8a-03945e09ce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:23.179660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 435/883] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:23.202947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61832c99-499c-4611-8fbe-04c658335ba0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:23.305081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3fa9-9f0f-480a-b97f-d2463769e87e None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.305699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3fa9-9f0f-480a-b97f-d2463769e87e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.305808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61832c99-499c-4611-8fbe-04c658335ba0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:23.306296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3fa9-9f0f-480a-b97f-d2463769e87e None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.308180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 436/884] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:23.313490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.314035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.314517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.331820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:23.333296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:23.340560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:23.341361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.341642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.341913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.353911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:23.362830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:23.364056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:23.365087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:23.372308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 449/885] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 22:29:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:23.374636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:23.427733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 437/886] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:23.451857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:23.489913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63175bf-6e4e-4a90-b05e-4c856e7e78f4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:23.525124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:23.525816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.526115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.526510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.527570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:23.527906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:23.529540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:23.543681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 450/887] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:29:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:23.546348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:23.574403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67160bc6-4af2-4acc-b788-886e477197c5 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:23.610730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bbd77-3899-4e55-b49c-de6cf14b0380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:23.611645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bbd77-3899-4e55-b49c-de6cf14b0380 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.612112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bbd77-3899-4e55-b49c-de6cf14b0380 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.612566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bbd77-3899-4e55-b49c-de6cf14b0380 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.613298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bbd77-3899-4e55-b49c-de6cf14b0380 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:23.614815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bbd77-3899-4e55-b49c-de6cf14b0380 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:23.644256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37802b-412b-4fd2-aa41-57a0cce66221 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:23.679226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:23.680044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.680330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.680606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.683808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 438/888] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:23 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:29:23.685352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b572b3-eb85-43c7-808c-2a23dd360b3d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.685825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b572b3-eb85-43c7-808c-2a23dd360b3d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.686735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b572b3-eb85-43c7-808c-2a23dd360b3d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.692416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 439/889] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:23.694086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6f8e-2183-4f8d-a910-843e0f201038 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.694418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6f8e-2183-4f8d-a910-843e0f201038 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.694662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6f8e-2183-4f8d-a910-843e0f201038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.695919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:23.697617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:23.713783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ff3e6f8e-2183-4f8d-a910-843e0f201038 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:23.715211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ff3e6f8e-2183-4f8d-a910-843e0f201038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:23.718176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:23.719312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:23.720462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:23.720462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:23.720462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:23.720462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:23.722498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 451/890] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:23.732742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:23.818321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 440/891] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:23.839148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60cd19-7ad3-4b4f-94eb-cf98cce88594 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.839330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60cd19-7ad3-4b4f-94eb-cf98cce88594 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.839629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60cd19-7ad3-4b4f-94eb-cf98cce88594 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.841360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 441/892] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:23.842194 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60cd19-7ad3-4b4f-94eb-cf98cce88594 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:23.869781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a81ac-c1b3-4c92-b663-ebb121b02eb8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:23.907076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:23.907820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.908100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.908376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.910244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:23.910244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:23.910841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c5fd8-2c4e-4e05-abfd-c7baec2f826a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:23.923928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 452/893] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:23.925283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b368199-44a9-4596-85f3-54007c000793 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.925567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b368199-44a9-4596-85f3-54007c000793 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.925838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b368199-44a9-4596-85f3-54007c000793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.941728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0b368199-44a9-4596-85f3-54007c000793 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:23.942888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0b368199-44a9-4596-85f3-54007c000793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:23.951334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60cd19-7ad3-4b4f-94eb-cf98cce88594 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:23.990999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:23.992135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:23.992602 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:23.992880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:23.993540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:23.994907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:24.007037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:24.008086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:24.008932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:24.011757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 442/894] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:24.012773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.015580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 453/895] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:24.017547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b368199-44a9-4596-85f3-54007c000793 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.114982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30290a-2893-485e-946d-5e3bec9aafb4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.127136 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b368199-44a9-4596-85f3-54007c000793 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.147837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.148639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.149003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.149279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.157163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.161172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.163755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.164654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.165129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.165594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.166486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:24.166981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.168593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.173610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 454/896] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:24.174644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:24.177457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:24.179108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 443/897] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:24.180418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.274714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e7e3-4191-44c4-95ca-0e99793b4bb5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.275021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b670-b833-4098-8966-57db9ee45372 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.306066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.306718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.307007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.307330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.308017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:24.308325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.308547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.309341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.309617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.309711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.309886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.310530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.312434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.319909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 444/898] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:24.319909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:24.329433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:24.330358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:24.331194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 455/899] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:24.332761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.416791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac8456-8e16-43c3-b71d-3cb9a0a36b35 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.432536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac675e8-0b4d-4894-9469-d4aec503dd02 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.453598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.454263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.454540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.454813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.455681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:24.455975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.457391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.468326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.469211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.469673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.470085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.471018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] RBAC: Adding query filter params (interface=public, service_id=3ba551403f77447abd363833aeba09c7, region_id=RegionOne) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:24.471318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.472710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.474674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 445/900] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:24.475671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.482479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 456/901] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/endpoints?service_id=3ba551403f77447abd363833aeba09c7&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:24.484079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.571995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16546ea8-c485-4259-bcd9-b48d984f46c4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.589273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a246640-3290-4424-8839-4ac18ae7c570 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.603964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.604617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.604895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.605162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.605855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:24.606156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.607503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.617182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 446/902] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:24.617182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.629749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.630405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.630843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.631127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.702561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.703953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.711813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cb686-0ffd-428c-ac00-b5f236a13b83 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.744858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.745518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.745803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.746091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.746757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.748182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.765570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 447/903] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/services => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:29:24.765570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.816007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 457/904] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:24.828318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.905479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50ca56-cdf2-4e16-81d6-6eb6ced65993 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.932216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a486d-e5e7-46f4-8b01-e33d085d9b19 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:24.946262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.946930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.947210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.947484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:24.948246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:24.948552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:24.950797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:24.956023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 448/905] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:24.962212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:24.985751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:24.986764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:24.987140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:24.987485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.000919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.002463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:25.020462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:25.021853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:25.023391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:25.023391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:25.023391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:25.023391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:25.023391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 458/906] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:25.029017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:25.085415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a12a57-2401-45f8-bc15-430c8ba6cee2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:25.120628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:25.121375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:25.121612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:25.121891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.122791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] RBAC: Adding query filter params (interface=public, service_id=584812694dfe4a66829f5f996149d203, region_id=RegionOne) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:25.123109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.124547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.130130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 449/907] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:24 2022] GET /identity/v3/endpoints?service_id=584812694dfe4a66829f5f996149d203&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:25.130477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793068e-0010-4014-bc11-8e180599cafd None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:25.137665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:25.166955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:25.167746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:25.167980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:25.168252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.169217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:25.169362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.171187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.187160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 459/908] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:25.188058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:25.246714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259765b-2489-481a-8f34-aa10ead58b5c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:25.283294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:25.284299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:25.284764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:25.285246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.286149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.287645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000daf8-7878-4e9d-94f5-cdedbf433b19 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:25.287925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.300052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 450/909] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:25 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:29:25.322854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:25.323693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:25.323977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:25.324253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.332699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.334186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:25.350018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:25.350976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:25.351937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 460/910] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:25.357481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:25.470531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7cc7f7-5e38-4b95-99d7-8917591ad7f6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:25.508166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:25.509074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:25.509526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:25.509803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.510592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:25.510901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.512353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a7fe3-dd73-44df-a7fa-8d35903c8bd3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.525257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 451/911] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:25.531942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:25.633902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b791737-2a2c-4fb2-9675-696a573ff3a8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:25.669437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:25.670415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:25.670791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:25.671163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:25.672140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] RBAC: Adding query filter params (role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=b8fef1a759164dfcbbf73546063fee79) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:25.672546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:25.674053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d44ed7-d7ae-472f-be13-d374fd58cc6a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:25.680290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 461/912] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:25 2022] GET /identity/v3/role_assignments?user.id=b8fef1a759164dfcbbf73546063fee79&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:26.017002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c327ee9-e9ea-4339-ae4f-bc33e985ae6b None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.017316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c327ee9-e9ea-4339-ae4f-bc33e985ae6b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.017562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c327ee9-e9ea-4339-ae4f-bc33e985ae6b None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.019067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 452/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:26.024500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.025052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.025550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.042519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:26.044031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:26.120851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 462/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:26.143571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c327ee9-e9ea-4339-ae4f-bc33e985ae6b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:26.247282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c327ee9-e9ea-4339-ae4f-bc33e985ae6b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:26.280428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:26.281322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.281598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.281870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.282514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:26.284136 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:26.297169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:26.298175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:26.299018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 453/915] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:26.306416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:26.405833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa96eec-6e7e-4cd5-85d4-9b5fa241c9f5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:26.439795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:26.440454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.440849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.441123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.441826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:26.442125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:26.443486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:26.448616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 463/916] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:26.456697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:26.558788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6c3f5-f136-4fd9-8aba-43f674c1a1b2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:26.592879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:26.593633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.593921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.594200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.594949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:26.595262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:26.596657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:26.601840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 454/917] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:26.607620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:26.708905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037cfbda-b5a7-4cc6-a74d-e0a2b52dcb5e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:26.744891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:26.745955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.746476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.746953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.747996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] RBAC: Adding query filter params (interface=public, service_id=4bace08a2de34972987011cd67131388, region_id=RegionOne) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:26.749166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:26.750734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5b4cd-9f59-46e8-ab51-bdfbcec82b09 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:26.756804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 464/918] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:26 2022] GET /identity/v3/endpoints?service_id=4bace08a2de34972987011cd67131388&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:26.763174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:26.866209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe93d4-c019-401e-b083-50517d7c63c6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:26.899458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a17e4-b212-4190-a6f0-9747c3813576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:26.900535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a17e4-b212-4190-a6f0-9747c3813576 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:26.901058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a17e4-b212-4190-a6f0-9747c3813576 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:26.901544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a17e4-b212-4190-a6f0-9747c3813576 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:26.902462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a17e4-b212-4190-a6f0-9747c3813576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:26.904151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a17e4-b212-4190-a6f0-9747c3813576 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:26.911715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 455/919] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:26 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:29:27.113074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda963d0-81dc-4fa2-9ddc-ab1ec73b39c0 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.113392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda963d0-81dc-4fa2-9ddc-ab1ec73b39c0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.113626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda963d0-81dc-4fa2-9ddc-ab1ec73b39c0 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.115000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 465/920] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:27.120289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.120521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.120803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.137688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:27.138870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:27.205832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 456/921] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:27.228930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda963d0-81dc-4fa2-9ddc-ab1ec73b39c0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:27.333929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda963d0-81dc-4fa2-9ddc-ab1ec73b39c0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:27.369901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:27.370747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.370978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.371249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.371928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:27.373378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:27.385062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:27.386047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:27.386887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 466/922] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:27.392716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:27.494689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614260e-3b7c-4c8e-9300-a5db65839565 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:27.533077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:27.533753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.534027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.534300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.535081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:27.535388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:27.536819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:27.542730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 457/923] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:27.548010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:27.646164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f9ca-1323-4a27-8ed0-1c31639b8267 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:27.679139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:27.679829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.680108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.680378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.681083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:27.681383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:27.682813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116c613-80d6-4416-b5ab-2fb27ed5da43 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:27.688182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 467/924] 10.222.0.23 () {56 vars in 1114 bytes} [Tue May 3 22:29:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:27.693328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:27.709456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ab2c9-7ec2-49be-9a30-d201f3a45bd5 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.709740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ab2c9-7ec2-49be-9a30-d201f3a45bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.710021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ab2c9-7ec2-49be-9a30-d201f3a45bd5 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.711646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 468/925] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:27.716357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.716642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.716920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.733757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:27.734930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:27.820600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 469/926] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:27.823687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdab578-c5cb-443a-bf9b-b3e5693578e7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:27.834397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:27.869423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693b511-5736-48b3-9d3b-50c913d9642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:27.871381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693b511-5736-48b3-9d3b-50c913d9642d None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.871963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693b511-5736-48b3-9d3b-50c913d9642d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.872471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693b511-5736-48b3-9d3b-50c913d9642d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.874030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693b511-5736-48b3-9d3b-50c913d9642d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:27.875637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693b511-5736-48b3-9d3b-50c913d9642d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:27.934378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5075e8a-19fd-44e1-9363-747098dde288 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:27.971194 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 458/927] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:27.981716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468d002-dae4-47b0-923c-c73d5ce11fa1 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.982062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468d002-dae4-47b0-923c-c73d5ce11fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.982376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468d002-dae4-47b0-923c-c73d5ce11fa1 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:27.989788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 459/928] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:27.992583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:27.993182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:27.993704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.001009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.001228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.001475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.001799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.002491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.003945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.013893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:28.015882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:28.017731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:28.018691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:28.020211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 470/929] 10.222.0.23 () {56 vars in 1132 bytes} [Tue May 3 22:29:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:28.026928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.121089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 460/930] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:28.143476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.169968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a58849-d99d-4582-8776-c944e07a926c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.209784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.210358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.210644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.210921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.211652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:28.211967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.213346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.219239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 471/931] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:28.224706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.253685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64077-6cf8-4b0d-813c-05b2ac080f73 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.288416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.289220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.289500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.289774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.300088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:28.308254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:28.309213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:28.310053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 461/932] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:28.320507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.328481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c736e4-c2e1-4422-bbe1-4c63ba7ba2ef None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.361426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.362072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.362351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.362625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.363355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:28.363663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.365037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.374986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 472/933] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:28.376866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.430330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f32d0-f1ef-41da-a939-0d22ba1d7810 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.465966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.466968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.468023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.468526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.469491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:28.469999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.471566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.483810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe280a5-5176-46c8-949f-f5accfcd0559 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.484105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 462/934] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:28.486088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.515505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.516192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.516475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.516748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.517496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.518908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.584734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d729817-f738-4450-8c9d-d869aebe5bdc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.624264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 473/935] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:29:28.630223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.631040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.631370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.631757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.645738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.647580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:28.667775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:28.668995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:28.670474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:28.670474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:28.670474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:28.670474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:28.670474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 463/936] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:28.674900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.791571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e857b5f-c6b8-4931-8584-aca2f14a2a28 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.827400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.828106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.828386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.828661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:28.829378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:28.829686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:28.831109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:28.844762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 474/937] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:28.850360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:28.956937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb420-ed4e-4279-9c56-25f16cf36b7f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:28.995027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:28.995869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:28.996158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:28.996430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.004030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.005459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:29.020787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:29.021773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:29.022719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 464/938] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:29:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:29.029511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.133891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ca5c7-f4a4-4344-8963-a2aa8139fc00 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.172157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.173154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.173576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.173991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.175062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:29.175517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.177126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf0f52-e857-4f93-a54a-89c3a2f4d044 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.197286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 475/939] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:29.204333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.306886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89bb09-8f0d-4254-98d9-1212301ed77f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.327049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ebc3-2b4f-40fa-9d0b-b0ee67492f1c None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.327674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ebc3-2b4f-40fa-9d0b-b0ee67492f1c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.328175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832ebc3-2b4f-40fa-9d0b-b0ee67492f1c None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.333362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 476/940] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:29.334944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.335448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.335948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.340938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058085-f12b-4e12-8485-df9569014282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.341721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058085-f12b-4e12-8485-df9569014282 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.342001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058085-f12b-4e12-8485-df9569014282 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.342825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37058085-f12b-4e12-8485-df9569014282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.353468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37058085-f12b-4e12-8485-df9569014282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.354834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:29.354964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37058085-f12b-4e12-8485-df9569014282 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.356576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-37058085-f12b-4e12-8485-df9569014282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:29.372122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:29.373060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:29.375208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:29.375208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:29.375208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:29.375208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:29.375208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 465/941] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:29.379488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058085-f12b-4e12-8485-df9569014282 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.436310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 477/942] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:29.456793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.480533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37058085-f12b-4e12-8485-df9569014282 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.515177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.515882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.516166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.516438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.517176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:29.517480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.518860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.531454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 466/943] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:29.536875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.564642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1991-7423-4498-ac36-cf82969fdf7d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.599445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.600423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.600702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.600974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.601623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.602985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:29.615077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:29.616233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:29.617243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 478/944] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:29.624541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.637154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429ee4-ea8a-4db0-96c8-12dfbb59b739 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.672135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.673043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.673393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.673794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.680889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.682425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:29.697229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:29.699056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:29.701223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:29.711641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 467/945] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:29.711641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.730706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a62c7-6302-49d0-ac4e-8f1da9bc81a5 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.765678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.766341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.766615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.766886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.767670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:29.767974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.769336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.779057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 479/946] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:29.780392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.807718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b8dff-c3e8-426a-9e91-5691ea580f38 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.842919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.843556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.843905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.844186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.845021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:29.845335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.846937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.865786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 468/947] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:29.867117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.894257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c2210-1dfc-49a9-80b1-f7583325b6b6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:29.928157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:29.928815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:29.929090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:29.929420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:29.930119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:29.930465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:29.931892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:29.941920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 480/948] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:29.943238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:29.966874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5b7c7-848f-4380-baa7-7254193ba4c8 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:30.008049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09985b-6898-4f30-bb4d-23d33b957cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:30.008937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09985b-6898-4f30-bb4d-23d33b957cad None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:30.009217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09985b-6898-4f30-bb4d-23d33b957cad None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:30.009490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09985b-6898-4f30-bb4d-23d33b957cad None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/b8fef1a759164dfcbbf73546063fee79/roles/6a7eae9ab2ba41c9855b27c0bc2e57b9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:30.011777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09985b-6898-4f30-bb4d-23d33b957cad None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=b8fef1a759164dfcbbf73546063fee79, role_id=6a7eae9ab2ba41c9855b27c0bc2e57b9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:30.013204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09985b-6898-4f30-bb4d-23d33b957cad None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:30.043000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36cb61-5fd2-40f5-a5a6-bd8d92ed5199 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:30.076169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b884b-5003-4f9b-8456-63f28293c322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:30.076947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b884b-5003-4f9b-8456-63f28293c322 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:30.077232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b884b-5003-4f9b-8456-63f28293c322 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:30.077503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b884b-5003-4f9b-8456-63f28293c322 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:30.078232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b884b-5003-4f9b-8456-63f28293c322 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:30.079583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b884b-5003-4f9b-8456-63f28293c322 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:30.100019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 469/949] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:29:29 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/b8fef1a759164dfcbbf73546063fee79/roles/6a7eae9ab2ba41c9855b27c0bc2e57b9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:29:30.195734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 481/950] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:30.368781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44675f70-e3d3-40cc-952e-4fc7a66a4b62 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:30.369773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44675f70-e3d3-40cc-952e-4fc7a66a4b62 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:30.370275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44675f70-e3d3-40cc-952e-4fc7a66a4b62 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:30.372412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 470/951] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:30.377874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:30.378161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:30.378408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:30.396315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:30.397506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:30.474111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 482/952] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:30.497347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44675f70-e3d3-40cc-952e-4fc7a66a4b62 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:30.598291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44675f70-e3d3-40cc-952e-4fc7a66a4b62 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:30.633132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:30.633719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:30.633996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:30.634270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:30.634979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:30.636441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:30.637800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING keystone.server.flask.common [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 22:29:30.705085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.sql.core [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 22:29:30.705085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 22:29:30.705085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [parameters: {'id': 'a695cdbc5c5948b4be1072216b8a0cfb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 22:29:30.705085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a695cdbc5c5948b4be1072216b8a0cfb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a695cdbc5c5948b4be1072216b8a0cfb. May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result = self._query(query) May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application conn.query(q) May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 22:29:30.712902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result.read() May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 03 22:29:30.713697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return project_ref.to_dict() May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application next(self.gen) May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application yield resource May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application next(self.gen) May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.session.rollback() May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.force_reraise() May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise self.value May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application session.commit() May 03 22:29:30.715070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._prepare_impl() May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.session.flush() May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._flush(objects) May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application compat.raise_( May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application flush_context.execute() May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 22:29:30.716013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rec.execute(self) May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application c = connection._execute_20( May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 22:29:30.717029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result = self._query(query) May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application conn.query(q) May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application result.read() May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 22:29:30.717987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [parameters: {'id': 'a695cdbc5c5948b4be1072216b8a0cfb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:30.718943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:30.720128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.Conflict( May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a695cdbc5c5948b4be1072216b8a0cfb. May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:30.721034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 471/953] 10.222.0.23 () {60 vars in 1140 bytes} [Tue May 3 22:29:30 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:30.722166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:30.821998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c6a16-a80c-4610-b1ca-0901010c3e27 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:30.862528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:30.863352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:30.863651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:30.863936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:30.871392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:30.872948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-bf16e72c-7e02-4029-ab2b-253f96e4e28b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:30.888553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:30.890918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:30.893086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 483/954] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:30.897205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:31.001557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970cbd6-a82f-47ec-b56a-b3923ea1422b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:31.016475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf375c-98b8-446c-9f86-38954a616d2d None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:31.016781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf375c-98b8-446c-9f86-38954a616d2d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:31.017041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf375c-98b8-446c-9f86-38954a616d2d None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:31.018709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 484/955] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:31.029240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:31.030178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:31.030625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:31.038166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:31.039026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:31.039479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:31.039922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:31.040824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:31.041278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:31.043050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:31.049273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:31.050631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:31.064644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 472/956] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:31.131307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 485/957] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:31.154133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:31.267119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776fd0-f13b-469e-a431-9d800a60499d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:31.301961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:31.303052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:31.303333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:31.303679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:31.304314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:31.305731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:31.318856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:31.319983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:31.321016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 473/958] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:31.325982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:31.426822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a3fcc-2458-4fb5-9c60-e9a7f99493ee None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:31.463583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:31.464264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:31.464540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:31.464808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:31.465511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:31.465809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:31.467908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c30a8ff-2e69-42c1-a35e-0849db4b7c1d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:31.473216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 486/959] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:31.478643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:31.584601 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525c481-5a4d-4f3f-a7dc-81108a5780d8 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:31.617758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:31.618468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:31.618747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:31.619071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:31.619876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:31.620180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:31.621526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f5e03-4190-49a4-8610-518651e63039 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:31.627071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 474/960] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:32.423937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ff19-fd4d-4942-b3e8-7ffbe4926275 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.424496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ff19-fd4d-4942-b3e8-7ffbe4926275 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.424496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02ff19-fd4d-4942-b3e8-7ffbe4926275 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.426082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 487/961] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:32.431591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaee8e-150b-4e3e-bbaf-1744cbf3635c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.431900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaee8e-150b-4e3e-bbaf-1744cbf3635c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.432180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaee8e-150b-4e3e-bbaf-1744cbf3635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.451012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-cdfaee8e-150b-4e3e-bbaf-1744cbf3635c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:32.453201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-cdfaee8e-150b-4e3e-bbaf-1744cbf3635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:32.524355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 475/962] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:32.547928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ff19-fd4d-4942-b3e8-7ffbe4926275 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:32.632139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db54ab-311a-43e5-9517-1b6a82402e4c None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.632465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db54ab-311a-43e5-9517-1b6a82402e4c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.632723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db54ab-311a-43e5-9517-1b6a82402e4c None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.634370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 476/963] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:32.639713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.640010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.640562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.653967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02ff19-fd4d-4942-b3e8-7ffbe4926275 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:32.660419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:32.660419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:32.700806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:32.701938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.702777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.703240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.717808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:32.728004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 477/964] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:32.728599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:32.729568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:32.730421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 488/965] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 22:29:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:32.739629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:32.751735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:32.849081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d840-2c0b-492f-872f-ac1bcfdda727 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:32.865031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0221f5-e36a-4292-a3c4-7efc68723b3b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:32.887079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:32.887966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.888273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.888549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.890109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:32.890413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:32.891802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:32.900117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 478/966] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:29:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:32.906052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:32.908330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:32.909242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:32.909615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:32.909982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:32.910757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:32.912257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:32.924845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:32.926147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:32.927942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:32.935647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 489/967] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:32.936963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.018478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bae75-5c25-4259-b281-b1128294ab31 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.059014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a5ce-8031-4833-b324-3fa4e7236516 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.060228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.061310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.061673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.062012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.075859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.078417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.095721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.096648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.097102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.097544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.098435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:33.098921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:33.100057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:33.100978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:33.101895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:33.101895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:33.101895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:33.101895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:33.102132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.102755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 479/968] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:33.107698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.111872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 490/969] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:33.121011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.218606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda7021-8752-435d-a56f-acd824acf133 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.240419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062ceb-6bd4-4b42-b1fa-a442bbf1b02d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.253489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.254478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.255030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.255676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.256740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:33.257249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.258831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.277492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 480/970] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:33.278522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.279360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.280140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.280464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.280791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.281551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:33.281905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.283335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.293626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 491/971] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:33.294897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.384571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309b576-6f43-49bc-9958-87d9c9b666f3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.400883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb59a2a-f1b7-4dd9-a687-2e49015281a3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.421920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.423102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.423589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.424115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.431815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.433745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.435282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.436593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.436995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.437284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.438439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] RBAC: Adding query filter params (interface=admin, service_id=4bace08a2de34972987011cd67131388, region_id=RegionOne) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:33.438439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.439929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.449998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 492/972] 10.222.0.23 () {56 vars in 1249 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/endpoints?service_id=4bace08a2de34972987011cd67131388&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:33.451316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:33.452578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:33.453657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 03 22:29:33.454662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:33.461803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 481/973] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:33.462963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.558386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0ace9-4837-4f54-b8e3-d357953f472e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.563926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404afa27-bf3c-46e0-939c-b53d352ad51d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.590590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eed5e-c239-4de2-8a2b-f3cf87e54fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.591245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eed5e-c239-4de2-8a2b-f3cf87e54fdd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.591529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eed5e-c239-4de2-8a2b-f3cf87e54fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.591829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eed5e-c239-4de2-8a2b-f3cf87e54fdd None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.592531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eed5e-c239-4de2-8a2b-f3cf87e54fdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.594197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eed5e-c239-4de2-8a2b-f3cf87e54fdd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.596481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.597144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.597426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.597702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.598540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:33.598850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.600291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.606969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 493/974] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:29:33.606969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faacd6-c416-4bb6-9322-c80f3416fd36 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.606969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faacd6-c416-4bb6-9322-c80f3416fd36 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.606969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52faacd6-c416-4bb6-9322-c80f3416fd36 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.611677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 494/975] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:33.614132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.614418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.614700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.631335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 482/976] 10.222.0.23 () {56 vars in 1149 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:33.632791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.633208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:33.634540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:33.716601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 495/977] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:33.735935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.746028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e1421-6961-4707-b05b-5b4b6072d777 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.783968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb388-0625-49c4-bb2c-a6cc0df85e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.785032 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb388-0625-49c4-bb2c-a6cc0df85e1c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.785537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb388-0625-49c4-bb2c-a6cc0df85e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.786025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb388-0625-49c4-bb2c-a6cc0df85e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.844545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e6bd6-66c3-49f9-97f7-8520d271a4a0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:33.864104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb388-0625-49c4-bb2c-a6cc0df85e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.865931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb388-0625-49c4-bb2c-a6cc0df85e1c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.889803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:33.890573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.891074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.891422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.892553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:33.894485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:33.896503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING keystone.server.flask.common [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 03 22:29:33.937499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.sql.core [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 22:29:33.937499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 22:29:33.937499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [parameters: {'user_id': '7564e82f3bba4a4a9c2ec24c4c23b72e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 22:29:33.937499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80276) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-f7b25a35-5bb8-4e11-872d-46da4a913548 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application result = self._query(query) May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application conn.query(q) May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application result.read() May 03 22:29:33.953509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 22:29:33.954484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application next(self.gen) May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application yield resource May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application next(self.gen) May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self.session.rollback() May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self.force_reraise() May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise self.value May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application session.commit() May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 03 22:29:33.955494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._prepare_impl() May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self.session.flush() May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._flush(objects) May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application compat.raise_( May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application flush_context.execute() May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rec.execute(self) May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 03 22:29:33.956477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application _emit_insert_statements( May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application result = connection._execute_20( May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ret = self._execute_context( May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 03 22:29:33.958150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self.dialect.do_execute( May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application result = self._query(query) May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application conn.query(q) May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application result.read() May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 03 22:29:33.960027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application packet.raise_for_error() May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [parameters: {'user_id': '7564e82f3bba4a4a9c2ec24c4c23b72e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:33.961098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 03 22:29:33.962153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 496/978] 10.222.0.23 () {60 vars in 1131 bytes} [Tue May 3 22:29:33 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410981-1209-4cbb-889a-12b610b5fb91 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410981-1209-4cbb-889a-12b610b5fb91 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.963370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6410981-1209-4cbb-889a-12b610b5fb91 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:33.964701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 497/979] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:33.964914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410981-1209-4cbb-889a-12b610b5fb91 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:33.983876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 483/980] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:33.983876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:33.983876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:33.983876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.000433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:34.001623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:34.067401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 484/981] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:34.068277 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.090981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6410981-1209-4cbb-889a-12b610b5fb91 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.128946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.129672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.129945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.130222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.137919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.139802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:34.155342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:34.156582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 498/982] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:34.157606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.175244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb69e1b-62fc-409e-8836-075e13bb4b81 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.208437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.209212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.209498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.209774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.219878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.221320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:34.238942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:34.239893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:34.240927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:34.240927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:34.240927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:34.240927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:34.240927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 485/983] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:34.240927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.261364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9add9d-b800-4f82-bd4e-8be24acb021b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.295812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.296482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.296769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.297049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.297770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.299137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.337155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770995e3-e00d-4067-b7ad-baaa7ec5fa62 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.362700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 499/984] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:34 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:34.363547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.387252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.388439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.390369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.390911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.392296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:34.392849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.395480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.445344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 486/985] 10.222.0.23 () {56 vars in 1101 bytes} [Tue May 3 22:29:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:34.496851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934d65-d814-4697-81cb-d4b8f00f0a6e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.538380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.539067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.539342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.539631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.540388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:34.540690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.542129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.557124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 500/986] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:34.562398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.673808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2614e6-db6f-4d37-bb0b-b7d316464784 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.708815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.709612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.709893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.710167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.717077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.718527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:34.732659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:34.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:34.734538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 487/987] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:34.740901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.843264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a647ff-76b4-480c-9961-44e663272078 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:34.876079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:34.876734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:34.877013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:34.877284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:34.878063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:34.878368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:34.879799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08921b20-107d-4b79-a84b-ad6d26d733ac None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:34.891624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 501/988] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:34.897480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:34.996701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459a275-ce8f-444f-a481-4014f3da1c6c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:35.029034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:35.029707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:35.029988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:35.030262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:35.031091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] RBAC: Adding query filter params (role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=b8fef1a759164dfcbbf73546063fee79) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:35.031402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:35.032835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931671e3-5fab-4e43-adad-a6954c2b6545 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:35.038556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 488/989] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:34 2022] GET /identity/v3/role_assignments?user.id=b8fef1a759164dfcbbf73546063fee79&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:35.965858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e73c7f-6789-4ced-8adf-4e17cf27eff0 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:35.966378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e73c7f-6789-4ced-8adf-4e17cf27eff0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:35.966378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e73c7f-6789-4ced-8adf-4e17cf27eff0 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:35.970479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 502/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:35.974017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:35.974396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:35.974679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:35.993250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:35.994506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:36.059643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 489/991] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:36.081184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e73c7f-6789-4ced-8adf-4e17cf27eff0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:36.188221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e73c7f-6789-4ced-8adf-4e17cf27eff0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:36.223036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:36.223789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.224074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.224350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.225008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:36.226444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:36.239397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:36.245862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:36.246773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 503/992] 10.222.0.23 () {56 vars in 1126 bytes} [Tue May 3 22:29:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:36.249290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:36.348809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1b0db-2fff-4c5f-925c-d115515cc582 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:36.380856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:36.381516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.381799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.382073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.382780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:36.383085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:36.384476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:36.394549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 490/993] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:36.396187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:36.492111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe71dc-4af7-4efd-9198-00b48ff6c36c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:36.527223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:36.527985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.528263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.528537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.529238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:36.529568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:36.530923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d096f-1aaf-480c-bbbf-6a144d914033 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:36.541820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 504/994] 10.222.0.23 () {56 vars in 1122 bytes} [Tue May 3 22:29:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:36.541979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:36.648647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a7df-d6ca-4236-9e9b-786754077dd7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:36.678565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910a8a-7637-4f46-96ed-0b62d19c21e9 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.679251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910a8a-7637-4f46-96ed-0b62d19c21e9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.679767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910a8a-7637-4f46-96ed-0b62d19c21e9 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.681307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 505/995] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:36.681795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:36.682444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.682725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.682998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.683807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:36.685153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:36.687111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.687674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.688145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.705053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:36.706549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:36.771290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 506/996] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:36.779339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 491/997] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:36.793977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:36.906418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8bfa5-dc85-4511-99b7-155b5362a4bb None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:36.954824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:36.955643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:36.955972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:36.956336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:36.957003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:36.958386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:36.972521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:36.974416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:36.975260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:36.976032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 507/998] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:36.978526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.077913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20640654-1085-4715-961e-dc95f6b8e519 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.110384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.111049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.111328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.111625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.112327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:37.112633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.113985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.123129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 492/999] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:37.124693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.226010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f25ff7-a694-49a9-9828-bf089e9b6b3c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.259055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.259749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.260032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.260032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.260032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:37.260032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.262645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee928-0fc5-47df-9e72-f08b6bc571bc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.268491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 508/1000] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:37.274021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.361491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744256-4da7-45f3-910b-c85aa165dfd4 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.361799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744256-4da7-45f3-910b-c85aa165dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.362049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25744256-4da7-45f3-910b-c85aa165dfd4 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.363573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 509/1001] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:37.368064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.368348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.368628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.373384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bc851-7d0e-4ed4-9fef-f16d58e8063b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.385029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:37.386191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:37.409538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.410192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.410471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.410744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.411532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] RBAC: Adding query filter params (interface=public, service_id=fbc2029e27854bfa8cc6413d2a95aacb, region_id=RegionOne) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:37.411875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.413229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.418054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 493/1002] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:37 2022] GET /identity/v3/endpoints?service_id=fbc2029e27854bfa8cc6413d2a95aacb&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:37.423332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.459908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 510/1003] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:37.481775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.519839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba5b54-2b36-49fb-a8e6-dad5bdacc6f4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.552917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.552917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.553802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.554036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.554609 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.556023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.562358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 494/1004] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:37 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:29:37.600609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227acad-f8fe-4714-9703-30ca068b5bbd None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.637648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.638820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.640138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.640423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] PATH_INFO: `/v3/services/image` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.641134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.642551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:37.654685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:37.655831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:37.656692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 511/1005] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 3 22:29:37 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:37.662096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.765698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e204b-a216-4f44-80f1-f85972a42940 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.797447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.798110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.798392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.798663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.799364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] RBAC: Adding query filter params (name=image) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:37.799697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.801060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346fff4-324b-463c-91ac-66cc81c44e32 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.810105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 495/1006] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:37.811947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:37.907177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba462441-662d-4fe2-abbc-1536e065825e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:37.939217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:37.939938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:37.940218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:37.940490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:37.941214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:37.941519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:37.942923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920063-99a6-4aa7-ae44-3f3dbfb33fd5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:37.954557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 512/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:39.067811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1185fd-fb68-45af-a7d7-9c50a8ac3fe8 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:39.068367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1185fd-fb68-45af-a7d7-9c50a8ac3fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:39.068367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1185fd-fb68-45af-a7d7-9c50a8ac3fe8 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:39.069868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 496/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:39.075118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17191-9829-49c9-946c-41667406c508 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:39.075516 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17191-9829-49c9-946c-41667406c508 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:39.075714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd17191-9829-49c9-946c-41667406c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:39.092029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9fd17191-9829-49c9-946c-41667406c508 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:39.093192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9fd17191-9829-49c9-946c-41667406c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:39.156580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 513/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:39.180035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1185fd-fb68-45af-a7d7-9c50a8ac3fe8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:39.275586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1185fd-fb68-45af-a7d7-9c50a8ac3fe8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:39.308272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f203c-7e7f-42b1-8beb-108afc0511de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:39.309144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f203c-7e7f-42b1-8beb-108afc0511de None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:39.309419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f203c-7e7f-42b1-8beb-108afc0511de None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:39.309688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f203c-7e7f-42b1-8beb-108afc0511de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:39.310853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f203c-7e7f-42b1-8beb-108afc0511de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:39.312363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f203c-7e7f-42b1-8beb-108afc0511de None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:39.314127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 497/1010] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:39.319735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17191-9829-49c9-946c-41667406c508 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:39.414146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd17191-9829-49c9-946c-41667406c508 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:39.445808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5f55-32ca-4a3b-87e4-6ca71760f209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:39.446478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5f55-32ca-4a3b-87e4-6ca71760f209 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:39.446759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5f55-32ca-4a3b-87e4-6ca71760f209 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:39.447032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5f55-32ca-4a3b-87e4-6ca71760f209 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:39.447781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5f55-32ca-4a3b-87e4-6ca71760f209 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:39.449220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5f55-32ca-4a3b-87e4-6ca71760f209 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:39.559708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 514/1011] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:39 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:39.816877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfcbb5-a94c-4676-8159-a9b0d89d49c9 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:39.817220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfcbb5-a94c-4676-8159-a9b0d89d49c9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:39.817350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfcbb5-a94c-4676-8159-a9b0d89d49c9 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:39.818739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 498/1012] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:39.824253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:39.824608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:39.824962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:39.843522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:39.844774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:39.915635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 515/1013] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:39.949464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfcbb5-a94c-4676-8159-a9b0d89d49c9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:40.056539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfcbb5-a94c-4676-8159-a9b0d89d49c9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:40.092356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:40.093124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.093338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.093600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.094243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:40.095597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-9f7a28e2-74e5-4480-9bce-eef466953515 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:40.107160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:40.108507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:40.109392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 499/1014] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:40.116099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:40.216361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7dc7e-7f51-4314-bec9-bf47ba556b1b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:40.249257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:40.249912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.250187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.250458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.251188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] RBAC: Adding query filter params (name=compute) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:40.251490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:40.252880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:40.254874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675cb3a-28f2-43e3-b7fb-f32f1ae3bacc None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.255288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675cb3a-28f2-43e3-b7fb-f32f1ae3bacc None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.255565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675cb3a-28f2-43e3-b7fb-f32f1ae3bacc None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.257123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 500/1015] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:40.262651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 516/1016] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:40.263371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:40.264798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.265092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.265366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.290651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:40.292614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:40.365946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 501/1017] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:40.380391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9554250-5b07-4bed-950a-3f0f9b7d2bba None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:40.400481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:40.416881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:40.421073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.421073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.421073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.421073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:40.421073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:40.421073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:40.430736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 517/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Tue May 3 22:29:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:40.433574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:40.515694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcaddb-b1f2-4d01-b31d-cef672cd2841 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:40.537285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74272a6c-b397-41fa-ad5c-b59cb7bc7398 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:40.556497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997c9a1-824a-40d8-b7f1-19d5d72ac317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:40.557166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c9a1-824a-40d8-b7f1-19d5d72ac317 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.557447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c9a1-824a-40d8-b7f1-19d5d72ac317 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.557725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997c9a1-824a-40d8-b7f1-19d5d72ac317 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.558883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c9a1-824a-40d8-b7f1-19d5d72ac317 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:40.561309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997c9a1-824a-40d8-b7f1-19d5d72ac317 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:40.572710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0082eb-f04c-42ab-8486-8c023c2984b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:40.573488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0082eb-f04c-42ab-8486-8c023c2984b1 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:40.573767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0082eb-f04c-42ab-8486-8c023c2984b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:40.574038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0082eb-f04c-42ab-8486-8c023c2984b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:40.574773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0082eb-f04c-42ab-8486-8c023c2984b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:40.576336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0082eb-f04c-42ab-8486-8c023c2984b1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:40.663714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 502/1019] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:29:40 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:29:40.681321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 518/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:29:41.969733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d927-59eb-4816-b78f-bf026c5abb66 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:41.969733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d927-59eb-4816-b78f-bf026c5abb66 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:41.969733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d927-59eb-4816-b78f-bf026c5abb66 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:41.970668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 503/1021] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:41.975917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:41.976317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:41.976479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:41.993708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:41.994885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:42.066212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 519/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:42.090186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9d927-59eb-4816-b78f-bf026c5abb66 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:42.191930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9d927-59eb-4816-b78f-bf026c5abb66 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:42.225432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995244b2-4efc-4966-b59c-6260fb62495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:42.226145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995244b2-4efc-4966-b59c-6260fb62495f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:42.226426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995244b2-4efc-4966-b59c-6260fb62495f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:42.226704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995244b2-4efc-4966-b59c-6260fb62495f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:42.227905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995244b2-4efc-4966-b59c-6260fb62495f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:42.229446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995244b2-4efc-4966-b59c-6260fb62495f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:42.236100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 504/1023] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:42.237658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:42.332245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fb4e2-73ba-4435-a699-0f3b11eebe6b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:42.365648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e355a-0d4a-4cd6-b193-b26c484afe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:42.366317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e355a-0d4a-4cd6-b193-b26c484afe1e None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:42.366599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e355a-0d4a-4cd6-b193-b26c484afe1e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:42.366877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e355a-0d4a-4cd6-b193-b26c484afe1e None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:42.367594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e355a-0d4a-4cd6-b193-b26c484afe1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:42.369055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e355a-0d4a-4cd6-b193-b26c484afe1e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:42.480905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 520/1024] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:29:42 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:42.958779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e4599-1f2a-481e-8d54-061290b99b09 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:42.959159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e4599-1f2a-481e-8d54-061290b99b09 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:42.959344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e4599-1f2a-481e-8d54-061290b99b09 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:42.960888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 505/1025] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:42.965768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:42.966061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:42.966339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:42.988319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:42.988868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:43.035302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e94ac-5f64-4a0a-b8c9-4436b740336e None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.036216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e94ac-5f64-4a0a-b8c9-4436b740336e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.036500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e94ac-5f64-4a0a-b8c9-4436b740336e None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.037889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 506/1026] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:43.042659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.043151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.043425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.055544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 521/1027] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:43.060417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:43.061704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:43.077981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.129331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 507/1028] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:43.152523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.172853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb442ebb-4d54-4a8e-a9fa-5d809e96eb87 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.205507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.206292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.206562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.206841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.207495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.208950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:43.220657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:43.221652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:43.222505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:43.226689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 522/1029] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:43.227523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.249534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4986bb6-2501-443c-8de2-c3521dcddd71 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.284915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.285730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.286014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.286292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.296377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:43.304442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:43.305477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:43.306937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 508/1030] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:43.311385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.330156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c152a-ba76-4b61-8379-9beb28166cd1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.364127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.364793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.365070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.365346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.366054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:43.366359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.367740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.372578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 523/1031] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:43.378221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.416234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f612274-cc6b-406a-bfe8-d80a9e57a991 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.448756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.449749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.450222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.450679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.452174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:43.452665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.454214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.462425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 509/1032] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:43.468194 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.479251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7f8bf-9232-4c6b-b3de-82d7907145fc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.518347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.519015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.519295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.519570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.520305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:43.520628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.521974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.526891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 524/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:43.532890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.565567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9541807-1e2c-48b2-a962-0d2796227090 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.599110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.600170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.600605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.601887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.612232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.613683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:43.631024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:43.632238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:43.633141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:43.633141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:43.633141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:43.633141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:43.633141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 510/1034] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:43.637164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518326c1-07ff-4867-8e5e-98d33d1f49b2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.637666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.682201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.682999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.683340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.683729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.684532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] RBAC: Adding query filter params (interface=public, service_id=b26ff1df9711495ea2ee76ee63942b65, region_id=RegionOne) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:43.684844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.686227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.691537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 525/1035] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/endpoints?service_id=b26ff1df9711495ea2ee76ee63942b65&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:43.696752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.744125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a63c16-8cd6-4c84-8932-a0625cff52df None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.781524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.782177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.782520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.782804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.783524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:43.783868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.785218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.795955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8678117-428b-4141-a19e-bb4d22ff7fe7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.802745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 511/1036] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:43.803552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:43.829393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.830050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.830334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.830609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.831282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.832688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.851632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 526/1037] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:29:43.900832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ac67d-e660-40c5-9a64-962ec6136981 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:43.936489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:43.937360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:43.937641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:43.937911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:43.950715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:43.952262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:43.978442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:43.979475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:43.980517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 512/1038] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:43.986263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:44.090844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059076e9-41b0-4986-ad3a-735b68284bad None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:44.129882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:44.130553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.130833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.131107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.131979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:44.132290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:44.133734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:44.156039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 527/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:29:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:44.157469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:44.253471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c3438-3a27-4132-9e68-0ce7571995d5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:44.287303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:44.288357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.288840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.289264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.363311 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:44.364781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:44.461536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 513/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:44.462710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:44.556969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab5a1b-de6f-41f2-93b4-e55ec04dedef None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:44.589712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:44.590491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.590766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.591033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.600659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:44.602085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:44.619518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:44.620706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:44.626955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:44.626955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:44.626955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:44.626955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:44.626955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 528/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:44.627238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:44.725500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06461ce2-9e79-47e9-a67b-5f55849c807e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:44.757866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:44.758525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.758807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.759081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.759828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:44.760139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:44.761501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9351010-2891-4600-bc6f-e833006fc572 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:44.777606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 514/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:44.778848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:44.810241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ba7a7-5f06-4cdd-9f5a-aea6c94e03bf None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.811134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ba7a7-5f06-4cdd-9f5a-aea6c94e03bf None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.811428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ba7a7-5f06-4cdd-9f5a-aea6c94e03bf None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.813883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 515/1043] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:44.819029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.819321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.819620 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.837767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:44.838939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:44.877652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa1746-57a1-45eb-bc0f-963d9a77680a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:44.907666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 516/1044] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:44.911192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:44.912016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:44.912298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:44.912572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:44.919224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:44.921236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:44.929079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:44.934677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:44.935924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:44.936836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 529/1045] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:44.942836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.034392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40627-3522-4fa8-9b97-5be25f77162d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.045602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf45594-031b-47b8-9d5b-96482fc2c524 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.066448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.067235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.067518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.067825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.078186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:45.078533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.079178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.079455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.079756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.080535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:45.080841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.082255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:45.085830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:45.086837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:45.087741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 517/1046] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:45.093548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.100018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 530/1047] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:45.101043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.188881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196efbf3-cd19-4fc6-ba02-144e0e7048f6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.201040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb702816-627b-46bb-ae60-da466f23ef41 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.220776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.221448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.221729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.222011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.222756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:45.223066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.224467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.233431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 518/1048] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:45.235648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.236471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.236750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.237025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.237852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] RBAC: Adding query filter params (role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=6d0846a688aa48a9a69fcb730dc5d7f5) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:45.238163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.239185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.239587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.245292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 531/1049] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:45 2022] GET /identity/v3/role_assignments?user.id=6d0846a688aa48a9a69fcb730dc5d7f5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:45.341343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f999f78-c0f2-4fc3-a387-72b60d4417d3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.375678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.376563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.376840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.377109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] PATH_INFO: `/v3/users/890e737c7d384abe8ecffecad222294b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.392478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=890e737c7d384abe8ecffecad222294b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.393939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.395735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 519/1050] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:29:45 2022] GET /identity/v3/users/890e737c7d384abe8ecffecad222294b => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:45.401529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.501011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6587f-ec89-4e0e-bd15-660d6aa8d6e3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.533463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.534104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.534380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.534645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.598047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.599506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.698844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 532/1051] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 22:29:45.700154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.796103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea75e3-356e-4e30-8346-b5fb64dfe5d6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.828117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ae96-7e95-4e60-8078-c1e191b4b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.828970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ae96-7e95-4e60-8078-c1e191b4b903 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.829255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ae96-7e95-4e60-8078-c1e191b4b903 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.829531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ae96-7e95-4e60-8078-c1e191b4b903 None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.830707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36ae96-7e95-4e60-8078-c1e191b4b903 None admin] RBAC: Authorizing `identity:get_project(project_id=92f67e6d82fb41a4a8f58548058c5678)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.832169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36ae96-7e95-4e60-8078-c1e191b4b903 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.834009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 520/1052] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:29:45 2022] GET /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:45.839863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:45.933454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc5e1f-2340-4e9f-828c-d9fdfc883570 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:45.975671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:45.975671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:45.975671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:45.975671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:45.976613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=92f67e6d82fb41a4a8f58548058c5678, user.id=890e737c7d384abe8ecffecad222294b) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:45.976613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:45.976613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451ee62-359a-465d-95b7-2e34751329c3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:45.981526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 533/1053] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:45 2022] GET /identity/v3/role_assignments?user.id=890e737c7d384abe8ecffecad222294b&scope.project.id=92f67e6d82fb41a4a8f58548058c5678&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:46.148134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdf86f-86a8-4787-adf3-b5daffad51f8 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:46.148468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdf86f-86a8-4787-adf3-b5daffad51f8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:46.148685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecdf86f-86a8-4787-adf3-b5daffad51f8 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:46.150333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 521/1054] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:46.156091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:46.156544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:46.156619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:46.174047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:46.175264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:46.247004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 534/1055] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:46.270328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdf86f-86a8-4787-adf3-b5daffad51f8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:46.368836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecdf86f-86a8-4787-adf3-b5daffad51f8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:46.401806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:46.402516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:46.402797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:46.403072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:46.403749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:46.405134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:46.416252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:46.417422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:46.418419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 522/1056] 10.222.0.23 () {56 vars in 1105 bytes} [Tue May 3 22:29:46 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:46.423856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:46.516193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c03ab-7bd4-4257-a1c8-f1e7cf3f7a5e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:46.547812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:46.548472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:46.548751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:46.549022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:46.549719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:46.550022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:46.551388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:46.556054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 535/1057] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:46.561668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:46.657034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab45631-fcb2-4a67-a2fb-58e888f721ee None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:46.689632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:46.690292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:46.690574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:46.690847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:46.691549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] RBAC: Adding query filter params (type=image) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:46.691932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:46.693288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5ad19-cbf2-44fe-8191-746ef38a6330 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:46.698106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 523/1058] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:46.704098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:46.804280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cb68c-36ce-4243-959a-c8ed633f6fe4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:46.836561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60c59a-40ee-4151-bfa8-6048826b78f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:46.837535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60c59a-40ee-4151-bfa8-6048826b78f6 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:46.838013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60c59a-40ee-4151-bfa8-6048826b78f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:46.838506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60c59a-40ee-4151-bfa8-6048826b78f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:46.839438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60c59a-40ee-4151-bfa8-6048826b78f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:46.841236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60c59a-40ee-4151-bfa8-6048826b78f6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:46.926453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 536/1059] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:29:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:29:47.485006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6461a1-70f2-425e-a958-83b0b6923934 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:47.485553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6461a1-70f2-425e-a958-83b0b6923934 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:47.485553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6461a1-70f2-425e-a958-83b0b6923934 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:47.486929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 524/1060] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:47.492426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:47.492829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:47.493008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:47.509145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:47.510404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:47.579289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 537/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:47.601389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6461a1-70f2-425e-a958-83b0b6923934 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:47.700575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6461a1-70f2-425e-a958-83b0b6923934 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:47.733212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:47.734019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:47.734297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:47.734564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:47.744977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:47.752923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:47.753861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:47.754718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:47.759157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 525/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 22:29:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:47.760573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:47.854358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c07c72-651a-4da0-83a7-36d6301aba6c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:47.885938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:47.886598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:47.886874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:47.887143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:47.887921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:47.888222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:47.890395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:47.903297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 538/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:29:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:47.905151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.005700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6782d30-d577-4938-86cc-5b88300c0eba None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.040093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.040891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.041175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.041453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.058415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.059931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:48.079586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:48.080642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:48.086642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:48.086642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:48.086642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:48.086642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:48.086642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 526/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:48.087175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.182504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862c210-5abe-4f5d-9e52-e94b94983da0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.214727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.215379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.215676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.215951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.216664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:48.216994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.218348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8591ff11-d0e2-4a7a-a177-d01c234fff8c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.229782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 539/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:48.235343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.243530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9bc5-2990-4d03-93c6-d8817bc9b4f3 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.243855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9bc5-2990-4d03-93c6-d8817bc9b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.244134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9bc5-2990-4d03-93c6-d8817bc9b4f3 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.245601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 540/1066] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:48.252987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.253282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.253566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.274731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:48.275854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:48.339338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829e14d-ad74-404d-886d-e4a32c4893fb None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.340432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 541/1067] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:48.362122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.370687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.371476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.371811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.372091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.380090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.381519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:48.395725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:48.396665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:48.397623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 527/1068] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:48.402535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.463190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fe423-2f7a-4cfc-97aa-0dd7961f41e0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.497012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.497819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.498613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.498890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.499890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e22e-433c-404f-9f5c-0c22cdd0cfe7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.509015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:48.517486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:48.518427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:48.524282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 542/1069] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:48.526442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.532856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.533521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.533802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.534072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.534905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:48.535208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.536652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.553883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 528/1070] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:48.559345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.624486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e545d14-314b-4a14-857a-80c999cfa9aa None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.654227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30df35-4d00-47a2-b86b-ed6a654999e6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.658496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.659164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.659448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.659758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.660506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:48.660813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.662224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.670554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 543/1071] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:48.677275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.690179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.690964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.691268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.691511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.702444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.703906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:48.720899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:48.721964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:48.723456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:48.723456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:48.723456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:48.723456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:48.723456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 529/1072] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:48.727652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.777488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df233c8-dc81-42c0-aa36-22fe998866a1 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.809769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.810771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.811054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.811330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] PATH_INFO: `/v3/users/890e737c7d384abe8ecffecad222294b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.812657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] RBAC: Authorizing `identity:get_user(user_id=890e737c7d384abe8ecffecad222294b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.814081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.815909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 544/1073] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/users/890e737c7d384abe8ecffecad222294b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:48.821590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.822341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82304bf7-ec0d-4a9a-9d8c-566fdb1fd931 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.855582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.856265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.856548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.856831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.857583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:48.857890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.859248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.875124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 530/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:48.876796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.919261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a841410-bb4c-4a82-bd8a-479146c31700 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:48.953898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:48.954746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:48.955022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:48.955297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:48.956565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=92f67e6d82fb41a4a8f58548058c5678)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:48.957988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:48.964386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 545/1075] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:48.965555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:48.977224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71191-f100-48c6-aa94-d25a06347c45 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.010246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.011106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.011392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.011998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.020111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.021584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:49.036870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:49.038011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:49.039145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:49.045822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 531/1076] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:49.046785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:49.074324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168263c-1602-4163-9531-023bd6e3e4e6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.107088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a36475-235b-431d-9b4b-9c6352b1948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.108034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36475-235b-431d-9b4b-9c6352b1948c None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.108316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36475-235b-431d-9b4b-9c6352b1948c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.108590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a36475-235b-431d-9b4b-9c6352b1948c None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678/users/890e737c7d384abe8ecffecad222294b/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.110547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a36475-235b-431d-9b4b-9c6352b1948c None admin] RBAC: Authorizing `identity:create_grant(project_id=92f67e6d82fb41a4a8f58548058c5678, user_id=890e737c7d384abe8ecffecad222294b, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.112017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a36475-235b-431d-9b4b-9c6352b1948c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.146114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f779dd-f2a3-42e6-be9a-bfb7fef36f80 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.178743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.179794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 546/1077] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:29:48 2022] PUT /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678/users/890e737c7d384abe8ecffecad222294b/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:29:49.179910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.184039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.184326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.185273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:49.186124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.187644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.200904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 532/1078] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:49.204655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f885858-f6e5-4f2c-85f4-3169d12e5cd5 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.204944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f885858-f6e5-4f2c-85f4-3169d12e5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.205224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f885858-f6e5-4f2c-85f4-3169d12e5cd5 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.206768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 547/1079] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:49.207231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:49.212186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.212468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.212741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.230019 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:49.231223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:49.302333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 548/1080] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:49.309705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8ed51-4940-4b82-b58e-e1baeeea6faf None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.324674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:49.345502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.346590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.346969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.347340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/6d0846a688aa48a9a69fcb730dc5d7f5/roles/6a7eae9ab2ba41c9855b27c0bc2e57b9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.349761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=6d0846a688aa48a9a69fcb730dc5d7f5, role_id=6a7eae9ab2ba41c9855b27c0bc2e57b9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.351297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.408091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 533/1081] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:29:49 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/6d0846a688aa48a9a69fcb730dc5d7f5/roles/6a7eae9ab2ba41c9855b27c0bc2e57b9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:29:49.426104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbb202-70f2-4add-bdfc-6597804b78eb None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.464355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.465189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.465569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.465947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.537176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.538657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.637067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 549/1082] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 22:29:49.643596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:49.739151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee993af8-2a27-4c9c-8871-a74eabddeac5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.771385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.772195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.772472 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.772741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.782782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.784245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-827e2cc1-0819-4807-95d4-cbfac548bc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:49.800384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:49.801531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:49.802662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:49.802662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:49.802662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:49.802662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:49.802662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 534/1083] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:49.807452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:49.901579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44309d8e-8144-4f18-9606-36da5ee325bd None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:49.932736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:49.933385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:49.933659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:49.933928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:49.934638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:49.934950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:49.936832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde8ce-d539-444c-a814-58f6638c7352 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:49.947730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 550/1084] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:51.419161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798415-c970-4b21-bec8-8dabba93c778 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.419713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798415-c970-4b21-bec8-8dabba93c778 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.419867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06798415-c970-4b21-bec8-8dabba93c778 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.421663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 535/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:51.426773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0580d8-a1d4-4383-bedd-4c56044730fa None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.427175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0580d8-a1d4-4383-bedd-4c56044730fa None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.427322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0580d8-a1d4-4383-bedd-4c56044730fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.443405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-df0580d8-a1d4-4383-bedd-4c56044730fa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:51.444597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-df0580d8-a1d4-4383-bedd-4c56044730fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:51.510915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 551/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:51.534819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798415-c970-4b21-bec8-8dabba93c778 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:51.628637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06798415-c970-4b21-bec8-8dabba93c778 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:51.660994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:51.661778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.662057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.662330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.667799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9f5d-0781-42ed-a290-27a4d43b0f93 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.668155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9f5d-0781-42ed-a290-27a4d43b0f93 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.668439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e9f5d-0781-42ed-a290-27a4d43b0f93 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.669922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 552/1087] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:29:51.673306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:51.674683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.675121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.675403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:51.680891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:51.682171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:29:51.683268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 536/1088] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:51.687834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:51.691982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:51.693166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:51.764352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 553/1089] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:29:51.783323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692d8d1-f011-4d82-a133-e311018b3354 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:51.788202 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:51.815337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:51.816020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.816302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.816574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.817311 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:51.817614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:51.818965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:51.827224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 537/1090] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:51.832872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:51.880945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efafd564-a1aa-4561-ad57-9871555e390c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:51.913491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:51.914288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.914575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.914849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.924704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:29:51.925835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166c239-47a5-4f9f-9252-d81f3bc7e18a None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:29:51.932613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:51.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:51.934410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 554/1091] 10.222.0.23 () {56 vars in 1120 bytes} [Tue May 3 22:29:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:51.940165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:51.958399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:51.959251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:51.959530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:51.959850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] PATH_INFO: `/v3/users/890e737c7d384abe8ecffecad222294b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:51.961041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] RBAC: Authorizing `identity:get_user(user_id=890e737c7d384abe8ecffecad222294b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:51.962457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:51.964105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 538/1092] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:29:51 2022] GET /identity/v3/users/890e737c7d384abe8ecffecad222294b => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:51.969780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.035703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c66063-81d5-4510-8bdd-08f6aaba9a74 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.064083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bdb8c1-edd5-4e8e-ad78-01e3ec6dcfd3 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.067028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.067719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.068000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.068271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.069014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:52.069317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.070703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.079016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 555/1093] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:29:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:52.084991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.106922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.107564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.107873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.108146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.174003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.175593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.184620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0229e-7d47-4ab0-89c5-5ea7c2a13473 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.217840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.218627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.218969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.219317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.229887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.231320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:52.247537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:52.249062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:52.250072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:52.250072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:52.250072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:52.250072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:52.250072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 556/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:52.254796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.277453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 539/1095] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 03 22:29:52.282965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.350232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca13586-423f-4fcd-aa9e-6f49c35f9ab3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.376750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8178b3-df04-4bb4-befe-22413004ac1d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.382096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.382744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.383025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.383300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.384045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:52.384351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.385700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.397186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 557/1096] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:52.402627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.417159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.418014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.418307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.418568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.420522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] RBAC: Authorizing `identity:get_project(project_id=92f67e6d82fb41a4a8f58548058c5678)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.421971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.423744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 540/1097] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:52.434717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.505088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f03437-2a55-4277-9ac2-7d7d7324c233 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.524550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dfec4-a27d-4ffe-a9ed-ca9fdd6a9d9c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.537005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.537787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.538070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.538348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.545675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.547111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.556432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.557069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.557352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.557632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.558462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=92f67e6d82fb41a4a8f58548058c5678, user.id=890e737c7d384abe8ecffecad222294b) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:52.558777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.560219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:29:52.561594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:52.562534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:52.563493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 558/1098] 10.222.0.23 () {56 vars in 1093 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:29:52.575650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 541/1099] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/role_assignments?user.id=890e737c7d384abe8ecffecad222294b&scope.project.id=92f67e6d82fb41a4a8f58548058c5678&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:52.575870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.670935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6b141-9d22-49b4-9c72-08f85f8022b8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.755521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.756312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.756597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.756874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.761638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:52.761954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.763413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:52.781934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 559/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:52.787877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:52.883517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2de14f-391a-44b4-9b7b-789e1140317e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:52.915627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:52.916288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:52.916569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:52.916871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:52.980802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:52.982269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:53.075966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 542/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:53.083772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:53.180743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc4075-8346-4627-8ff0-44a518db70db None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:53.212465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:53.213239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:53.213517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:53.213787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:53.224296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:53.225725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:29:53.242507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:53.243425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:53.244380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:29:53.244380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:29:53.244380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:29:53.244380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:53.247905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 560/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:53.249565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:53.343717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72204f1-dc43-4e58-9cb3-20683ca16b9c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:53.375531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:53.376201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:53.376482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:53.376755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:53.377474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:53.377779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:53.379139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:53.390873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 543/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:53.396502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:53.497640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883da5b-e7e9-4310-809f-54b5e3f593ed None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:53.531010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:53.531821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:53.532101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:53.532372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:53.538729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:53.540188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:29:53.553458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:29:53.554619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:29:53.556276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 561/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:29:53.560878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:53.654789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c570cd-c168-44b0-91ef-ba41b580f838 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:53.688583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:53.689276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:53.689520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:53.689794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:53.690581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:53.690890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:53.692352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce020a36-7969-4dd7-b22f-a93270e1a41b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:53.705914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 544/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:53.712192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:53.808135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b388b-a6a5-4a6b-b023-61d5bc8906d9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:53.839689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:53.840333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:53.840616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:53.840894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:53.841746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] RBAC: Adding query filter params (role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=6d0846a688aa48a9a69fcb730dc5d7f5) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:53.842060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:53.843488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f98651-7fa0-424b-93fd-3942e057f462 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:53.849298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 562/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:53 2022] GET /identity/v3/role_assignments?user.id=6d0846a688aa48a9a69fcb730dc5d7f5&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=6a7eae9ab2ba41c9855b27c0bc2e57b9 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:29:54.840321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf201-88ea-4a1b-9bb3-decac3a40853 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:54.840884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf201-88ea-4a1b-9bb3-decac3a40853 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:54.840884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf201-88ea-4a1b-9bb3-decac3a40853 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:54.842788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 545/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:54.847966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:54.848366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:54.848520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:54.865142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:54.866328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:54.929126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 563/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:54.954069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf201-88ea-4a1b-9bb3-decac3a40853 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:55.048400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf201-88ea-4a1b-9bb3-decac3a40853 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:55.080146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45734723-2197-4162-a244-9829c6e7079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:55.080915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734723-2197-4162-a244-9829c6e7079a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:55.081196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734723-2197-4162-a244-9829c6e7079a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:55.081471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734723-2197-4162-a244-9829c6e7079a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:55.082621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734723-2197-4162-a244-9829c6e7079a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:55.084080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734723-2197-4162-a244-9829c6e7079a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:55.085672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 546/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:29:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:55.091346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:55.184290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4ab3-f1da-439f-8b85-3055871a04fb None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:55.217357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93caf7-fa36-4bf2-aae6-bd5883de6900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:55.218004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93caf7-fa36-4bf2-aae6-bd5883de6900 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:55.218278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93caf7-fa36-4bf2-aae6-bd5883de6900 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:55.218549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93caf7-fa36-4bf2-aae6-bd5883de6900 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:55.219246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93caf7-fa36-4bf2-aae6-bd5883de6900 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:55.220687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93caf7-fa36-4bf2-aae6-bd5883de6900 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:55.324510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 564/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:29:55 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:29:57.598135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a291c6-4b77-4512-91b6-769146933fa6 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:57.598698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a291c6-4b77-4512-91b6-769146933fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:57.598698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a291c6-4b77-4512-91b6-769146933fa6 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:57.600066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 547/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:29:57.605216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:57.605590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:57.605767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:57.621775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:29:57.622936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:29:57.685718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 565/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:29:57.708405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a291c6-4b77-4512-91b6-769146933fa6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:57.805807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a291c6-4b77-4512-91b6-769146933fa6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:57.837733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:57.838667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:57.838992 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:57.839266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] PATH_INFO: `/v3/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:57.840765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] RBAC: Authorizing `identity:get_role(role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:57.842348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:57.843712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 548/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:29:57 2022] GET /identity/v3/roles/01fa319c34404bab84538eca6b902bdb => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:57.849414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:57.943221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bbf6f-6b70-430c-8322-96e44e416b94 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:57.975245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:57.976127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:57.976442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:57.976710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] PATH_INFO: `/v3/users/0899fc63a2444b618972d77fa3cc225c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:57.989903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] RBAC: Authorizing `identity:get_user(user_id=0899fc63a2444b618972d77fa3cc225c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:57.991325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:57.992982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 566/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:29:57 2022] GET /identity/v3/users/0899fc63a2444b618972d77fa3cc225c => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:57.998607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:58.091274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93138-d6d7-4ec1-b16e-91f1d5a67209 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:58.124815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:58.125414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:58.125690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:58.125960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:58.189075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:58.190519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:58.281920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 549/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:29:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:29:58.287962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:58.390598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776202-ed97-4e79-8376-e63288a20997 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:58.422656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b6e7-4ba5-4c1c-aa22-a65c7a556bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:58.423923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b6e7-4ba5-4c1c-aa22-a65c7a556bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:58.423923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b6e7-4ba5-4c1c-aa22-a65c7a556bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:58.424098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b6e7-4ba5-4c1c-aa22-a65c7a556bb8 None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:58.425257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b6e7-4ba5-4c1c-aa22-a65c7a556bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=92f67e6d82fb41a4a8f58548058c5678)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:58.426676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b6e7-4ba5-4c1c-aa22-a65c7a556bb8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:58.428367 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 567/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:29:58 2022] GET /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:29:58.434530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:29:58.533216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500dcaf-44ac-4052-a4cf-1e48b1cc9d75 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:29:58.564079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:29:58.564707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:29:58.564984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:29:58.565255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:29:58.566063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] RBAC: Adding query filter params (role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=92f67e6d82fb41a4a8f58548058c5678, user.id=0899fc63a2444b618972d77fa3cc225c) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:29:58.566370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:29:58.567792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a745f-32e8-436d-98ea-3d76736c071d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:29:58.572885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 550/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:29:58 2022] GET /identity/v3/role_assignments?user.id=0899fc63a2444b618972d77fa3cc225c&scope.project.id=92f67e6d82fb41a4a8f58548058c5678&role.id=01fa319c34404bab84538eca6b902bdb => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:00.796708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b309-a47e-4c6f-a218-3bc2bc898312 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:00.797241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b309-a47e-4c6f-a218-3bc2bc898312 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:00.797241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191b309-a47e-4c6f-a218-3bc2bc898312 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:00.798590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 568/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:00.803675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:00.804055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:00.804228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:00.820863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:00.822034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:00.883666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 551/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:00.906418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b309-a47e-4c6f-a218-3bc2bc898312 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:01.001615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191b309-a47e-4c6f-a218-3bc2bc898312 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:01.033815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:01.034650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:01.034928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:01.035200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] PATH_INFO: `/v3/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:01.036668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] RBAC: Authorizing `identity:get_role(role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:01.038032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:01.039383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 569/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:00 2022] GET /identity/v3/roles/01fa319c34404bab84538eca6b902bdb => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:01.045668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:01.135703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db5059-6a36-49cd-afeb-e4949d35bc2a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:01.167282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:01.168155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:01.168434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:01.168704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] PATH_INFO: `/v3/users/0899fc63a2444b618972d77fa3cc225c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:01.169871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] RBAC: Authorizing `identity:get_user(user_id=0899fc63a2444b618972d77fa3cc225c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:01.171287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:01.173501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 552/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:01 2022] GET /identity/v3/users/0899fc63a2444b618972d77fa3cc225c => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:01.179267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:01.272800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db683647-99f9-4acb-9b4c-c0913883a747 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:01.304309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf840ad-ca53-4947-8c1c-d5781be21da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:01.305138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf840ad-ca53-4947-8c1c-d5781be21da3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:01.305416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf840ad-ca53-4947-8c1c-d5781be21da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:01.305687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf840ad-ca53-4947-8c1c-d5781be21da3 None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:01.306847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf840ad-ca53-4947-8c1c-d5781be21da3 None admin] RBAC: Authorizing `identity:get_project(project_id=92f67e6d82fb41a4a8f58548058c5678)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:01.308302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf840ad-ca53-4947-8c1c-d5781be21da3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:01.309956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 570/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:01 2022] GET /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:01.315879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:01.409348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78406ce-ce88-4275-8f20-0eb5f4e21913 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:01.440073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89546c6e-711d-4380-bf05-132490f36770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:01.440943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89546c6e-711d-4380-bf05-132490f36770 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:01.441226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89546c6e-711d-4380-bf05-132490f36770 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:01.441503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89546c6e-711d-4380-bf05-132490f36770 None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678/users/0899fc63a2444b618972d77fa3cc225c/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:01.443695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89546c6e-711d-4380-bf05-132490f36770 None admin] RBAC: Authorizing `identity:create_grant(project_id=92f67e6d82fb41a4a8f58548058c5678, user_id=0899fc63a2444b618972d77fa3cc225c, role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:01.445101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89546c6e-711d-4380-bf05-132490f36770 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:01.509454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 553/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:30:01 2022] PUT /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678/users/0899fc63a2444b618972d77fa3cc225c/roles/01fa319c34404bab84538eca6b902bdb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:30:03.738183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043c21-1ae2-4ed1-be17-062145fbf022 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:03.738716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043c21-1ae2-4ed1-be17-062145fbf022 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:03.738716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c043c21-1ae2-4ed1-be17-062145fbf022 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:03.740139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 571/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:03.745284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:03.745688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:03.745829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:03.765304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:03.766489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:03.828538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 554/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:03.851993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043c21-1ae2-4ed1-be17-062145fbf022 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:03.948800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c043c21-1ae2-4ed1-be17-062145fbf022 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:03.980727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:03.981569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:03.981847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:03.982117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] PATH_INFO: `/v3/roles/01fa319c34404bab84538eca6b902bdb` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:03.983567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] RBAC: Authorizing `identity:get_role(role_id=01fa319c34404bab84538eca6b902bdb)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:03.985519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:03.986874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 572/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:03 2022] GET /identity/v3/roles/01fa319c34404bab84538eca6b902bdb => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:03.992773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:04.083940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c60cab-58e2-4709-95be-fc0101b224b9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:04.115863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:04.116710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:04.116988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:04.117260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] PATH_INFO: `/v3/users/0899fc63a2444b618972d77fa3cc225c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:04.118418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] RBAC: Authorizing `identity:get_user(user_id=0899fc63a2444b618972d77fa3cc225c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:04.119860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:04.121445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 555/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:03 2022] GET /identity/v3/users/0899fc63a2444b618972d77fa3cc225c => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:04.126997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:04.221346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0270-83b1-43bc-a273-ab409deb38f7 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:04.252573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:04.253147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:04.253430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:04.253709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:04.316500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:04.317935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:04.411409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 573/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:30:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:30:04.417522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:04.513202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeba7e7-af60-4f92-8c69-ea17c26b603c None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:04.547892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9b193-35c9-4dbf-8a0a-38d33a138b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:04.548720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b193-35c9-4dbf-8a0a-38d33a138b94 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:04.548995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b193-35c9-4dbf-8a0a-38d33a138b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:04.549263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9b193-35c9-4dbf-8a0a-38d33a138b94 None admin] PATH_INFO: `/v3/projects/92f67e6d82fb41a4a8f58548058c5678` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:04.550734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b193-35c9-4dbf-8a0a-38d33a138b94 None admin] RBAC: Authorizing `identity:get_project(project_id=92f67e6d82fb41a4a8f58548058c5678)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:04.552233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9b193-35c9-4dbf-8a0a-38d33a138b94 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:04.553869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 556/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:04 2022] GET /identity/v3/projects/92f67e6d82fb41a4a8f58548058c5678 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:04.559744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:04.656598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc7a2-fed4-4449-9b08-f3edc0e0a0bc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:04.689082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:04.689722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:04.690007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:04.690282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:04.691530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] RBAC: Adding query filter params (role.id=01fa319c34404bab84538eca6b902bdb, scope.project.id=92f67e6d82fb41a4a8f58548058c5678, user.id=0899fc63a2444b618972d77fa3cc225c) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:04.692081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:04.694704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd5ca6-f0a8-46ca-adff-22ceb61a4d35 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:04.703772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 574/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:30:04 2022] GET /identity/v3/role_assignments?user.id=0899fc63a2444b618972d77fa3cc225c&scope.project.id=92f67e6d82fb41a4a8f58548058c5678&role.id=01fa319c34404bab84538eca6b902bdb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:06.941022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048152-2ea1-4c57-8ad1-11cc5780d1d0 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:06.941586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048152-2ea1-4c57-8ad1-11cc5780d1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:06.941586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048152-2ea1-4c57-8ad1-11cc5780d1d0 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:06.942925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 557/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:06.948207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:06.948631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:06.948766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:06.964898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:06.966084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:07.028845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 575/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:07.052286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048152-2ea1-4c57-8ad1-11cc5780d1d0 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:07.146429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048152-2ea1-4c57-8ad1-11cc5780d1d0 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:07.178691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae866ba7-675f-4e72-b1a9-f5e6047ce170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:07.179463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae866ba7-675f-4e72-b1a9-f5e6047ce170 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:07.179771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae866ba7-675f-4e72-b1a9-f5e6047ce170 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:07.180045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae866ba7-675f-4e72-b1a9-f5e6047ce170 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:07.181218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae866ba7-675f-4e72-b1a9-f5e6047ce170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:07.182636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae866ba7-675f-4e72-b1a9-f5e6047ce170 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:07.184255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 558/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:07.191869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:07.283883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc40549-49fc-4767-be48-4a4c85838825 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:07.315918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689e11d-c791-441d-8beb-da9a14844e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:07.316564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689e11d-c791-441d-8beb-da9a14844e72 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:07.316845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689e11d-c791-441d-8beb-da9a14844e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:07.317119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689e11d-c791-441d-8beb-da9a14844e72 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:07.317822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689e11d-c791-441d-8beb-da9a14844e72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:07.319252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689e11d-c791-441d-8beb-da9a14844e72 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:07.408053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 576/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:30:07 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:30:09.705132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3c80-9f53-4cad-9d62-41397db13d59 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:09.705722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3c80-9f53-4cad-9d62-41397db13d59 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:09.705722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e3c80-9f53-4cad-9d62-41397db13d59 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:09.707028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 559/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:09.712131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:09.712548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:09.712692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:09.729551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:09.730726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:09.793991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 577/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:09.819189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3c80-9f53-4cad-9d62-41397db13d59 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:09.913711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e3c80-9f53-4cad-9d62-41397db13d59 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:09.953742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0f3d3-acd7-4980-84a3-910120251cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:09.954504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0f3d3-acd7-4980-84a3-910120251cee None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:09.954783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0f3d3-acd7-4980-84a3-910120251cee None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:09.955052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0f3d3-acd7-4980-84a3-910120251cee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:09.956293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0f3d3-acd7-4980-84a3-910120251cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:09.957658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0f3d3-acd7-4980-84a3-910120251cee None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:09.959243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 560/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:09.964952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:10.057358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340af84-e35e-4266-ab24-7bf7469afa00 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:10.089678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df9a0a-e0a5-46a0-9746-03bc687f94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:10.090330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df9a0a-e0a5-46a0-9746-03bc687f94a6 None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:10.090612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df9a0a-e0a5-46a0-9746-03bc687f94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:10.090887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df9a0a-e0a5-46a0-9746-03bc687f94a6 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:10.091594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df9a0a-e0a5-46a0-9746-03bc687f94a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:10.093046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df9a0a-e0a5-46a0-9746-03bc687f94a6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:10.178200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 578/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:30:09 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:30:12.418739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c0616-9821-4255-a62f-b5d5ac9dead4 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:12.419295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c0616-9821-4255-a62f-b5d5ac9dead4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:12.419295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c0616-9821-4255-a62f-b5d5ac9dead4 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:12.420677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 561/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:12.426444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:12.426852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:12.427007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:12.443361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:12.444599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:12.516470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 579/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:12.540290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c0616-9821-4255-a62f-b5d5ac9dead4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:12.635289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c0616-9821-4255-a62f-b5d5ac9dead4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:12.668061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:12.668874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:12.669113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:12.669389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:12.679247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:30:12.686847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:12.688082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:30:12.689221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 562/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:30:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:12.693829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:12.787140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f450a-a5dd-4af1-9245-20ef6f516fb0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:12.818768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:12.819421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:12.819733 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:12.820013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:12.820755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:12.821063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:12.822430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:12.830644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 580/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:12.836280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:12.930362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246fa9e4-90c4-4763-b55a-dbb37f41f69d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:12.961874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:12.962712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:12.962994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:12.963266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] PATH_INFO: `/v3/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:12.975713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] RBAC: Authorizing `identity:get_user(user_id=9b5b6c575f2749b3b5e33c6d3ee8a7bb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:12.977157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:12.978786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 563/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:12 2022] GET /identity/v3/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:12.984473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:13.079098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6436201-cd97-4e90-9e25-b37223286efa None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:13.110208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:13.110844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:13.111125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:13.111401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:13.174478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:13.175944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:13.268577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 581/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:30:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:30:13.274338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:13.366241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d3198-1c8e-4885-a69e-1bb8bb7aaced None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:13.399070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cddc8-5348-4862-bedd-7aba52d05dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:13.399946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cddc8-5348-4862-bedd-7aba52d05dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:13.400227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cddc8-5348-4862-bedd-7aba52d05dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:13.400505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cddc8-5348-4862-bedd-7aba52d05dc7 None admin] PATH_INFO: `/v3/projects/e7ed97921c874a19b2b4d8340ebc8909` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:13.401775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cddc8-5348-4862-bedd-7aba52d05dc7 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ed97921c874a19b2b4d8340ebc8909)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:13.403216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cddc8-5348-4862-bedd-7aba52d05dc7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:13.404926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 564/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:13 2022] GET /identity/v3/projects/e7ed97921c874a19b2b4d8340ebc8909 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:13.411055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:13.513690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38375647-c3d2-45e3-bbe3-ca64df2774eb None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:13.549861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:13.550431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:13.550714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:13.550991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:13.551903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=e7ed97921c874a19b2b4d8340ebc8909, user.id=9b5b6c575f2749b3b5e33c6d3ee8a7bb) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:13.552217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:13.553662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72e643-f399-437d-aca0-4d35e2f21cfe None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:13.558992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 582/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:30:13 2022] GET /identity/v3/role_assignments?user.id=9b5b6c575f2749b3b5e33c6d3ee8a7bb&scope.project.id=e7ed97921c874a19b2b4d8340ebc8909&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:30:15.772896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60de8-053a-4afb-9b34-8b37c5967a41 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:15.773441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60de8-053a-4afb-9b34-8b37c5967a41 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:15.773441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e60de8-053a-4afb-9b34-8b37c5967a41 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:15.774801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 565/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:15.779923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:15.780343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:15.780478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:15.797538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:15.798718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:15.862285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 583/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:15.884638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60de8-053a-4afb-9b34-8b37c5967a41 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:15.979885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e60de8-053a-4afb-9b34-8b37c5967a41 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:16.011624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:16.012422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:16.012701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:16.012971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:16.023310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:30:16.030745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:16.031889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:30:16.033115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 566/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:16.038041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:16.130717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7a1ca-1de0-4d8d-a69b-1398cadd33f9 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:16.162705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:16.163358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:16.163659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:16.163936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:16.164685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:16.164986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:16.166348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:16.174162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 584/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:16.180066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:16.274995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ac2a0-40c5-4700-9ad0-472256b14bab None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:16.306599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:16.307452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:16.307774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:16.308049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] PATH_INFO: `/v3/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:16.309225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b5b6c575f2749b3b5e33c6d3ee8a7bb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:16.310649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:16.312887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 567/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:16 2022] GET /identity/v3/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:16.318665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:16.417556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb8f8b-c183-4ab5-8dd7-a87a2975190a None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:16.463089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b1ec-aa5f-4511-9a23-0e5fbd8eded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:16.463965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b1ec-aa5f-4511-9a23-0e5fbd8eded0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:16.464246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b1ec-aa5f-4511-9a23-0e5fbd8eded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:16.464519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b1ec-aa5f-4511-9a23-0e5fbd8eded0 None admin] PATH_INFO: `/v3/projects/e7ed97921c874a19b2b4d8340ebc8909` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:16.465688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b1ec-aa5f-4511-9a23-0e5fbd8eded0 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ed97921c874a19b2b4d8340ebc8909)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:16.467127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b1ec-aa5f-4511-9a23-0e5fbd8eded0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:16.468874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 585/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:16 2022] GET /identity/v3/projects/e7ed97921c874a19b2b4d8340ebc8909 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:16.474889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:16.569096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbff94-0834-4f1f-9246-92790dfeb7d5 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:16.600765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc0f0f-fb9e-4416-bf6d-0465c62a3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:16.601642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0f0f-fb9e-4416-bf6d-0465c62a3f0b None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:16.601921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0f0f-fb9e-4416-bf6d-0465c62a3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:16.602191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc0f0f-fb9e-4416-bf6d-0465c62a3f0b None admin] PATH_INFO: `/v3/projects/e7ed97921c874a19b2b4d8340ebc8909/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:16.604154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc0f0f-fb9e-4416-bf6d-0465c62a3f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=e7ed97921c874a19b2b4d8340ebc8909, user_id=9b5b6c575f2749b3b5e33c6d3ee8a7bb, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:16.605579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc0f0f-fb9e-4416-bf6d-0465c62a3f0b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:16.755576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 568/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:30:16 2022] PUT /identity/v3/projects/e7ed97921c874a19b2b4d8340ebc8909/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:30:18.950478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6331339-b92a-4742-a959-419aed9eb04e None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:18.951018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6331339-b92a-4742-a959-419aed9eb04e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:18.951018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6331339-b92a-4742-a959-419aed9eb04e None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:18.952403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 586/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:18.958099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:18.958498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:18.958655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:18.975772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:18.976960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:19.040315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 569/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:19.063411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6331339-b92a-4742-a959-419aed9eb04e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:19.160170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6331339-b92a-4742-a959-419aed9eb04e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:19.192458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:19.193225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:19.193502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:19.193772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:19.204049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:30:19.211393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:19.212331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:30:19.213323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 587/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:19.218782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:19.314079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae7191-51e6-4c5c-a3a8-cd01c8b077d8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:19.345748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:19.346410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:19.346693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:19.346973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:19.347752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:19.348063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:19.349441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:19.357493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 570/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:19.363821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:19.460455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6fd-1dc8-4bea-b0dc-6b0aa91a2a57 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:19.492368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:19.493222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:19.493500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:19.493768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] PATH_INFO: `/v3/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:19.494933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] RBAC: Authorizing `identity:get_user(user_id=9b5b6c575f2749b3b5e33c6d3ee8a7bb)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:19.496394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:19.498160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 588/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:19 2022] GET /identity/v3/users/9b5b6c575f2749b3b5e33c6d3ee8a7bb => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:19.503803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:19.597689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a2486-0c75-450c-a726-a6c22b9d9cdb None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:19.629082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:19.629758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:19.630041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:19.630316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:19.693584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:19.695020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:19.787120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 571/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:30:19.793050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:19.886811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1cc5-e1bf-4768-847e-522a0a670137 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:19.920645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fe862-17a7-4400-a358-247c0202cae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:19.921530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe862-17a7-4400-a358-247c0202cae1 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:19.921812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe862-17a7-4400-a358-247c0202cae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:19.922086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe862-17a7-4400-a358-247c0202cae1 None admin] PATH_INFO: `/v3/projects/e7ed97921c874a19b2b4d8340ebc8909` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:19.923721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fe862-17a7-4400-a358-247c0202cae1 None admin] RBAC: Authorizing `identity:get_project(project_id=e7ed97921c874a19b2b4d8340ebc8909)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:19.925083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fe862-17a7-4400-a358-247c0202cae1 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:19.926862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 589/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:19 2022] GET /identity/v3/projects/e7ed97921c874a19b2b4d8340ebc8909 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:19.933199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:20.026393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f8d91-df52-4a67-9594-744bc4ed595f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:20.057976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:20.058560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:20.058836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:20.059106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:20.059962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=e7ed97921c874a19b2b4d8340ebc8909, user.id=9b5b6c575f2749b3b5e33c6d3ee8a7bb) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:20.060273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:20.061682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b69178-b4e6-43f4-95cf-f0ace062b4e7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:20.067813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 572/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:30:19 2022] GET /identity/v3/role_assignments?user.id=9b5b6c575f2749b3b5e33c6d3ee8a7bb&scope.project.id=e7ed97921c874a19b2b4d8340ebc8909&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:22.318927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd897-bc77-4e98-ac94-6872fc536b7c None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:22.319444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd897-bc77-4e98-ac94-6872fc536b7c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:22.319444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd897-bc77-4e98-ac94-6872fc536b7c None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:22.320777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 590/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:22.325947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:22.326349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:22.326503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:22.343168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:22.344868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:22.405260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 573/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:30:22.427038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd897-bc77-4e98-ac94-6872fc536b7c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:22.526216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd897-bc77-4e98-ac94-6872fc536b7c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:22.557661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:22.558294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:22.558572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:22.558868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:22.628487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:22.629933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:22.721056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 591/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:30:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:30:22.726923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:22.818257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f12e0-a5e0-4f47-9a67-5d340bd934e4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:22.849257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:22.850030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:22.850306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:22.850575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:22.856861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:22.858286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-932c8b02-6b94-4f21-ac31-83c96ce15f70 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:22.871921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:22.873142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:30:22.874198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 574/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:30:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:22.879547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:22.978067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0127-66ce-4697-ad17-6f163191bbba None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:23.011649 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:23.012297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:23.012575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:23.012847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:23.013557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:23.013858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:23.015508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a484a5c-c402-4323-bbf5-5b331cc3c87e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:23.022464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 592/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue May 3 22:30:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:25.245142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd690b-4d0a-41de-8e67-855953285518 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:25.245635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd690b-4d0a-41de-8e67-855953285518 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:25.245635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd690b-4d0a-41de-8e67-855953285518 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:25.246979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 575/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:25.252601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445440cc-ec77-4c40-ade5-c7db97b30d52 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:25.252998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445440cc-ec77-4c40-ade5-c7db97b30d52 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:25.253150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445440cc-ec77-4c40-ade5-c7db97b30d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:25.269551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-445440cc-ec77-4c40-ade5-c7db97b30d52 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:25.270715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-445440cc-ec77-4c40-ade5-c7db97b30d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:25.333301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 593/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:25.355893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd690b-4d0a-41de-8e67-855953285518 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:25.451789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd690b-4d0a-41de-8e67-855953285518 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:25.482350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee80a0-a8c0-4b56-b17d-a90a9f0245de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:25.482986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee80a0-a8c0-4b56-b17d-a90a9f0245de None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:25.483266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee80a0-a8c0-4b56-b17d-a90a9f0245de None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:25.483540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee80a0-a8c0-4b56-b17d-a90a9f0245de None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:25.484803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee80a0-a8c0-4b56-b17d-a90a9f0245de None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:25.486162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee80a0-a8c0-4b56-b17d-a90a9f0245de None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:25.579497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 576/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue May 3 22:30:25 2022] POST /identity/v3/domains => generated 267 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:30:27.829103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e690ab-6799-4a27-afae-34de36a00920 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:27.829664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e690ab-6799-4a27-afae-34de36a00920 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:27.829664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e690ab-6799-4a27-afae-34de36a00920 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:27.831010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 594/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:27.836139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:27.836583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:27.836701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:27.853939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:27.855126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:27.927490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 577/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:30:27.950404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e690ab-6799-4a27-afae-34de36a00920 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:28.045437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e690ab-6799-4a27-afae-34de36a00920 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:28.077187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19776133-515b-4b69-b9d6-338866e05b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:28.078060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19776133-515b-4b69-b9d6-338866e05b47 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:28.078337 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19776133-515b-4b69-b9d6-338866e05b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:28.078607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19776133-515b-4b69-b9d6-338866e05b47 None admin] PATH_INFO: `/v3/domains/75c275ee72674d80ae8093849eae370b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:28.088552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19776133-515b-4b69-b9d6-338866e05b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=75c275ee72674d80ae8093849eae370b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:28.089946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19776133-515b-4b69-b9d6-338866e05b47 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:28.091562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 595/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue May 3 22:30:27 2022] GET /identity/v3/domains/75c275ee72674d80ae8093849eae370b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:28.098162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:28.190198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6342b0-1a88-4631-a27b-847eaa1b6553 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:28.222304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f85d9d-b25a-42b7-a0b1-c8b2aff95b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:28.222953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f85d9d-b25a-42b7-a0b1-c8b2aff95b79 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:28.223234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f85d9d-b25a-42b7-a0b1-c8b2aff95b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:28.223510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f85d9d-b25a-42b7-a0b1-c8b2aff95b79 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:28.224245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f85d9d-b25a-42b7-a0b1-c8b2aff95b79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:28.225663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f85d9d-b25a-42b7-a0b1-c8b2aff95b79 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:28.321710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 578/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:30:28 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:30:30.574789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30050e04-0320-4388-b53a-97f67f6f2f2b None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:30.575380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30050e04-0320-4388-b53a-97f67f6f2f2b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:30.575477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30050e04-0320-4388-b53a-97f67f6f2f2b None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:30.577237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 596/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:30.583065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:30.583486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:30.583646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:30.601168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:30.611512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:30.674656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 579/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:30.698729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30050e04-0320-4388-b53a-97f67f6f2f2b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:30.795029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30050e04-0320-4388-b53a-97f67f6f2f2b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:30.826237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7fc09-ec7d-4cf7-adba-15ad21200ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:30.827049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7fc09-ec7d-4cf7-adba-15ad21200ebd None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:30.827868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7fc09-ec7d-4cf7-adba-15ad21200ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:30.828148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7fc09-ec7d-4cf7-adba-15ad21200ebd None admin] PATH_INFO: `/v3/domains/75c275ee72674d80ae8093849eae370b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:30.829349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7fc09-ec7d-4cf7-adba-15ad21200ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=75c275ee72674d80ae8093849eae370b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:30.830780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7fc09-ec7d-4cf7-adba-15ad21200ebd None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:30.832444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 597/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue May 3 22:30:30 2022] GET /identity/v3/domains/75c275ee72674d80ae8093849eae370b => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:30.838110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:30.930787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4016b-e218-48b9-91b1-dcd981460134 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:30.964609 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615af61-4693-4a04-b705-b668baa5619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:30.965277 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615af61-4693-4a04-b705-b668baa5619f None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:30.965557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615af61-4693-4a04-b705-b668baa5619f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:30.965833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615af61-4693-4a04-b705-b668baa5619f None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:30.966543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615af61-4693-4a04-b705-b668baa5619f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:30.968038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615af61-4693-4a04-b705-b668baa5619f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:31.074788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 580/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:30:30 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:30:33.344898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b7a23-0c8d-4bb3-b555-aa79d04075ae None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:33.345426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b7a23-0c8d-4bb3-b555-aa79d04075ae None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:33.345530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b7a23-0c8d-4bb3-b555-aa79d04075ae None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:33.346819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 598/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:33.352007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:33.352398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:33.352572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:33.369391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:33.370571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:33.433573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 581/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:33.457493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b7a23-0c8d-4bb3-b555-aa79d04075ae None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:33.554927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b7a23-0c8d-4bb3-b555-aa79d04075ae None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:33.587863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:33.588639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:33.588914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:33.589183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:33.598809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:30:33.606270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:33.607177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:30:33.608081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 599/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:30:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:33.614105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:33.706629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1d422-f23d-45ad-bcba-17213e0b7bc8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:33.789270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:33.789932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:33.790210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:33.790489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:33.791235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:33.791544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:33.792932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:33.801314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 582/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:30:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:33.807201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:33.902818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541beebe-dfe0-4a67-a2ae-b4b2804b0eb4 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:33.935041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13059c7f-0006-489b-8184-99015c617685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:33.935942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13059c7f-0006-489b-8184-99015c617685 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:33.936226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13059c7f-0006-489b-8184-99015c617685 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:33.936501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13059c7f-0006-489b-8184-99015c617685 None admin] PATH_INFO: `/v3/users/fc79e83e8ed943179a9efed764874a2e` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:33.949707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13059c7f-0006-489b-8184-99015c617685 None admin] RBAC: Authorizing `identity:get_user(user_id=fc79e83e8ed943179a9efed764874a2e)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:33.951153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13059c7f-0006-489b-8184-99015c617685 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:33.952876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 600/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:33 2022] GET /identity/v3/users/fc79e83e8ed943179a9efed764874a2e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:33.958739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:34.053057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091bad8-377f-45d6-8f32-c866b521242e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:34.083153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:34.083801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:34.084079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:34.084351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:34.146307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:34.147767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:34.238378 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 583/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:30:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:30:34.244200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13059c7f-0006-489b-8184-99015c617685 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:34.337449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13059c7f-0006-489b-8184-99015c617685 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:34.368890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827da03-e156-49bb-9919-6cb2131ad5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:34.369725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827da03-e156-49bb-9919-6cb2131ad5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:34.370000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827da03-e156-49bb-9919-6cb2131ad5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:34.370267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827da03-e156-49bb-9919-6cb2131ad5d2 None admin] PATH_INFO: `/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:34.371404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827da03-e156-49bb-9919-6cb2131ad5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=5babae1a5fc747f9ac69e3f8fbf5452a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:34.372870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827da03-e156-49bb-9919-6cb2131ad5d2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:34.374514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 601/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:34 2022] GET /identity/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:34.380567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:34.473319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fad42-aabd-40e8-87cd-a3f7b85e35ae None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:34.504356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:34.504942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:34.506002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:34.506002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:34.506310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=5babae1a5fc747f9ac69e3f8fbf5452a, user.id=fc79e83e8ed943179a9efed764874a2e) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:34.506621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:34.508099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650bc18-f70e-49a6-9238-c207f0a12793 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:34.519289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 584/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:30:34 2022] GET /identity/v3/role_assignments?user.id=fc79e83e8ed943179a9efed764874a2e&scope.project.id=5babae1a5fc747f9ac69e3f8fbf5452a&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:36.746578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819d40-39ec-4585-b1d3-3094cc6c3419 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:36.747155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819d40-39ec-4585-b1d3-3094cc6c3419 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:36.747155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819d40-39ec-4585-b1d3-3094cc6c3419 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:36.748511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 602/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:36.753931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:36.754382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:36.754491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:36.771966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:36.773143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:36.838698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 585/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:36.861520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819d40-39ec-4585-b1d3-3094cc6c3419 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:36.963324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819d40-39ec-4585-b1d3-3094cc6c3419 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:37.000156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:37.000873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:37.001148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:37.001416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:37.011316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:30:37.019547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:37.020829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:30:37.021751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 603/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:30:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:37.026869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:37.122181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736a2ae-ef41-4210-aceb-84c057966119 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:37.159701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:37.160396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:37.160679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:37.160957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:37.161708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:37.162015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:37.163399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:37.171767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 586/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:37.177511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:37.277769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149d7cb-53ad-4a7b-9d80-01ac969f9388 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:37.311074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:37.312598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:37.312789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:37.313069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] PATH_INFO: `/v3/users/fc79e83e8ed943179a9efed764874a2e` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:37.314273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] RBAC: Authorizing `identity:get_user(user_id=fc79e83e8ed943179a9efed764874a2e)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:37.315736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:37.317534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 604/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:37 2022] GET /identity/v3/users/fc79e83e8ed943179a9efed764874a2e => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:37.323244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:37.420088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5644f-c8ca-47c9-ad25-ed151ddf2974 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:37.454277 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6273f7-1098-4632-ae1f-fe2d0b95cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:37.455163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6273f7-1098-4632-ae1f-fe2d0b95cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:37.455441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6273f7-1098-4632-ae1f-fe2d0b95cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:37.455790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6273f7-1098-4632-ae1f-fe2d0b95cbe4 None admin] PATH_INFO: `/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:37.456995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6273f7-1098-4632-ae1f-fe2d0b95cbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=5babae1a5fc747f9ac69e3f8fbf5452a)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:37.458425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6273f7-1098-4632-ae1f-fe2d0b95cbe4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:37.460173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 587/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:37 2022] GET /identity/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:37.466051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:37.564163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b950a1-c9c2-4720-ba7a-da7bb2bb866c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:37.597667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea48129-f02e-4a01-9000-34656d9eef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:37.598560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea48129-f02e-4a01-9000-34656d9eef60 None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:37.598837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea48129-f02e-4a01-9000-34656d9eef60 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:37.599109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea48129-f02e-4a01-9000-34656d9eef60 None admin] PATH_INFO: `/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a/users/fc79e83e8ed943179a9efed764874a2e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:37.601087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea48129-f02e-4a01-9000-34656d9eef60 None admin] RBAC: Authorizing `identity:create_grant(project_id=5babae1a5fc747f9ac69e3f8fbf5452a, user_id=fc79e83e8ed943179a9efed764874a2e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:37.602504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea48129-f02e-4a01-9000-34656d9eef60 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:37.732771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 605/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:30:37 2022] PUT /identity/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a/users/fc79e83e8ed943179a9efed764874a2e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:30:39.988441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f19488-8130-498f-b9d3-3e418dd0fd5a None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:39.988953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f19488-8130-498f-b9d3-3e418dd0fd5a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:39.989038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f19488-8130-498f-b9d3-3e418dd0fd5a None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:39.990364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 588/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:30:39.996134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:39.996881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:39.996881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:40.017604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:30:40.019163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:30:40.089618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 606/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:30:40.114632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f19488-8130-498f-b9d3-3e418dd0fd5a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:40.223559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f19488-8130-498f-b9d3-3e418dd0fd5a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:40.259421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:40.260259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:40.260611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:40.260960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:40.274474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:30:40.282726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:30:40.283823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:30:40.284698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 589/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:30:40.290403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:40.399336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b93f-7b88-4853-8360-9010c79a750c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:40.437854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:40.438531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:40.438813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:40.439088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:40.439883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:40.440190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:40.441578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:40.450180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 607/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:30:40.456544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:40.565312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ef5e2-349f-48b7-9f97-db65cef8ff87 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:40.603709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:40.604582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:40.604860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:40.605134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] PATH_INFO: `/v3/users/fc79e83e8ed943179a9efed764874a2e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:40.606326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] RBAC: Authorizing `identity:get_user(user_id=fc79e83e8ed943179a9efed764874a2e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:40.608779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:40.612726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 590/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue May 3 22:30:40 2022] GET /identity/v3/users/fc79e83e8ed943179a9efed764874a2e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:40.618286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:40.722665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787f656-0b46-43dd-a297-acebad139cf8 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:40.754515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:40.755148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:40.755421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:40.755720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:40.822271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:40.823682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:40.919646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 608/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:30:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:30:40.923415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:41.021807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e197c6-6969-47f1-ac8d-cd8d5a0eb899 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:41.053905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0421d1-6bfe-4f3a-8e1e-e75a90d6871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:41.054754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0421d1-6bfe-4f3a-8e1e-e75a90d6871d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:41.055031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0421d1-6bfe-4f3a-8e1e-e75a90d6871d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:41.055302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0421d1-6bfe-4f3a-8e1e-e75a90d6871d None admin] PATH_INFO: `/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:41.056728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0421d1-6bfe-4f3a-8e1e-e75a90d6871d None admin] RBAC: Authorizing `identity:get_project(project_id=5babae1a5fc747f9ac69e3f8fbf5452a)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:41.058168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0421d1-6bfe-4f3a-8e1e-e75a90d6871d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:41.060061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 591/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue May 3 22:30:40 2022] GET /identity/v3/projects/5babae1a5fc747f9ac69e3f8fbf5452a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:30:41.066494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:30:41.162114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393488f-1f30-4765-b603-71773149cb0b None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:30:41.195119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:30:41.195796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:30:41.196081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:30:41.196362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:30:41.197189 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=5babae1a5fc747f9ac69e3f8fbf5452a, user.id=fc79e83e8ed943179a9efed764874a2e) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:30:41.197502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:30:41.198918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62740adf-a149-4bc8-b382-77c1c6eff6fe None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:30:41.204939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 609/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:30:41 2022] GET /identity/v3/role_assignments?user.id=fc79e83e8ed943179a9efed764874a2e&scope.project.id=5babae1a5fc747f9ac69e3f8fbf5452a&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:32:06.689728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff273f2-ff7a-46ef-b82c-73f52c9967ab None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:06.690323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff273f2-ff7a-46ef-b82c-73f52c9967ab None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:06.690323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff273f2-ff7a-46ef-b82c-73f52c9967ab None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:06.691693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 592/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:06.697491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:06.697892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:06.698037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:06.714376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:06.715543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:06.780014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 610/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:06.804697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff273f2-ff7a-46ef-b82c-73f52c9967ab None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:06.902369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff273f2-ff7a-46ef-b82c-73f52c9967ab None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:06.934259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:06.935029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:06.935309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:06.935593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:06.945750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:06.947135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:06.963835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:06.964971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:06.966039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:06.966039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:06.966039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:06.966039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:06.966039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 593/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:06.971027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:07.065488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddab20-e431-4c9a-b15c-d76a41acd8cc None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:07.105377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:07.106259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:07.106591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:07.106867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:07.107586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:07.107918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:07.109298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fb554-4540-4042-8d10-d7fcbc5867d0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:07.120762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 611/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:07.126405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:07.220480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3832be-3180-4641-bfc2-78e9f3e09500 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:07.251328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c9d2f-8e3c-433b-b0d5-1c41e8d2e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:07.252004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9d2f-8e3c-433b-b0d5-1c41e8d2e442 None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:07.252284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9d2f-8e3c-433b-b0d5-1c41e8d2e442 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:07.252556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9d2f-8e3c-433b-b0d5-1c41e8d2e442 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:07.253255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c9d2f-8e3c-433b-b0d5-1c41e8d2e442 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:07.254658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c9d2f-8e3c-433b-b0d5-1c41e8d2e442 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:07.404590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 594/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue May 3 22:32:07 2022] POST /identity/v3/users => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:32:09.665537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274895d-1546-4533-9a78-fe167583d653 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:09.666132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274895d-1546-4533-9a78-fe167583d653 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:09.666132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274895d-1546-4533-9a78-fe167583d653 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:09.667447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 612/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:09.672467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:09.672864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:09.673024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:09.689610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:09.690808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:09.754290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 595/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:09.777716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274895d-1546-4533-9a78-fe167583d653 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:09.875581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274895d-1546-4533-9a78-fe167583d653 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:09.908039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:09.908816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:09.909092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:09.909364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:09.918976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:32:09.926458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:09.927666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:09.929211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 613/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:32:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:09.933968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:10.028784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f798963-8a5f-449d-ba5d-d3a80206b973 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:10.060989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:10.061646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:10.061927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:10.062202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:10.062947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:10.063253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:10.064723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:10.072453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 596/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:32:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:10.078199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:10.173909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dac5c-60d0-4ada-91b2-789e990f0cdb None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:10.205864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:10.206639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:10.206918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:10.207187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:10.217248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:10.218695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:10.235436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:10.236840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:10.237886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:10.237886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:10.237886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:10.237886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:10.237886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 614/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:10.243321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:10.336817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244831ef-bdca-4741-8994-f482299f90c4 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:10.368678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:10.369324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:10.369650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:10.369930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:10.370653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:10.370952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:10.372325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:10.383425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 597/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:10.389183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:10.483273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57648a-0596-4db5-b744-3fd5f85174d0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:10.514355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:10.515145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:10.516703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:10.516703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:10.523682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:10.525179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:32:10.539507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:10.540670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:10.541787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 615/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:10.546631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:10.640722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cde84-42db-4523-8a3a-4f8ec9c584e7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:10.674945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:10.675593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:10.675900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:10.676191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:10.677006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:10.677315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:10.679274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:10.699072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 598/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 22:32:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:10.704915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:10.802378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06bd2-5a2a-41a6-a52f-e7531f9eddf9 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:10.834255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:10.834904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:10.835181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:10.835454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:10.899159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:10.900650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:10.995287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 616/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:32:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:32:11.000916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:11.102905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80007752-461a-41fc-9a3e-f62b0d5e3a66 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:11.137134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:11.137914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:11.138192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:11.138462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:11.148849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:11.150282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:11.167332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:11.168536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:11.169764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:11.169764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:11.169764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:11.169764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:11.169764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 599/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:11.174246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:11.267959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64de27-4f9e-4e38-98b0-62b2d48b4c85 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:11.299871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:11.300512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:11.300797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:11.301073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:11.301784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:11.302088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:11.303987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:11.314723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 617/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:11.320974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:11.425561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f31a23-4a84-4340-95fc-b84702818581 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:11.457603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:11.458390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:11.458664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:11.458934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:11.465473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:11.466911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:32:11.480413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:11.481461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:11.483744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 600/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:32:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:11.487552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:11.583315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a512-f65f-4a97-ad1b-b50a9cb72816 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:11.615423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:11.616651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:11.616933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:11.617207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:11.617988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:11.618295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:11.619747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21b028-31e2-4137-947e-6e100de360ca None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:11.631273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 618/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:11.637458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:11.736751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b1d0b-14a1-4db1-8264-94f597047f61 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:11.769091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:11.769758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:11.770039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:11.770313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:11.771133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=166a670867884c689f3dd5c93b58b97f) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:11.771444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:11.772925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0bccf-acf3-44bf-a065-72488cc322c1 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:11.778272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 601/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:32:11 2022] GET /identity/v3/role_assignments?user.id=166a670867884c689f3dd5c93b58b97f&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:13.998387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56a51-e197-4740-affb-2cbc653acda4 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:13.998846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56a51-e197-4740-affb-2cbc653acda4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:13.998937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d56a51-e197-4740-affb-2cbc653acda4 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.000337 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 619/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:14.005550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:14.007150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:14.007150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.024229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:14.025438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:14.089276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 602/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:14.111691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d56a51-e197-4740-affb-2cbc653acda4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:14.208802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d56a51-e197-4740-affb-2cbc653acda4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:14.242247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:14.242963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:14.243240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:14.243508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.253497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:32:14.261262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:14.262376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:14.263301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 620/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:14.268777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:14.362384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77cbe-9557-4f59-a638-5d048daddc63 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:14.394641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:14.395328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:14.395636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:14.395909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.396646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:14.396950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:14.398793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:14.406343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 603/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:14.412142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:14.508177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1c3f6-0601-4523-bfdc-1e60ab62ca65 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:14.540134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:14.540901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:14.541183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:14.541455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.551530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:14.552997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:14.569912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:14.570974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:14.571996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:14.571996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:14.571996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:14.571996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:14.571996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 621/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:14.577003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:14.675680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541482-7230-4e80-949b-b7ad4bab5fbe None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:14.708238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:14.708894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:14.709171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:14.709443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.710757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:14.711062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:14.712453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:14.723587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 604/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:14.729235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:14.825595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e81c-38c0-4fac-a428-ce90cbc40e60 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:14.856982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:14.857759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:14.858035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:14.858304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:14.865387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:14.866873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:32:14.880612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:14.882383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:14.883499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 622/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 03 22:32:14.888192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:14.981065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eefb6-510a-487d-bb26-eb90802ad0d6 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:15.013738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:15.014393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:15.014669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:15.014937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:15.015834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:15.016139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:15.017817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:15.034369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 605/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 22:32:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:15.040089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:15.136441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc712af-642d-41ba-b695-95d52dfa7242 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:15.168434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:15.169206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:15.169485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:15.169756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:15.180301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:15.181738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:15.198514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:15.199533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:15.200456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:15.200456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:15.200456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:15.200456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:15.200456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 623/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:15.205417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:15.299619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69883f-e4ad-48cb-b19f-4b4305d8e34f None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:15.334908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:15.335558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:15.335865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:15.336142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:15.336858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:15.337171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:15.338535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:15.349293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 606/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:15.355710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:15.451237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc13814-5d12-4279-9008-c02082d3168d None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:15.482794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:15.483575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:15.483886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:15.484157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:15.490579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:15.492087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:32:15.505811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:15.507412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:15.510267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 624/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:32:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:15.513506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:15.608530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c1cc-06bf-4f7a-8f5a-a22b3ec6e904 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:15.640380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:15.641026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:15.641313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:15.641586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:15.642635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:15.642945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:15.644402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed382f4b-bc9c-4fb7-90db-ae5f4915019f None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:15.657113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 607/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:32:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:15.663061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:15.758364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1bfcb-fd86-4f56-a7d1-5f4daf72cc35 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:15.790731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442ebce-92b4-4f33-8b2b-4adf8d5fa52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:15.791647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442ebce-92b4-4f33-8b2b-4adf8d5fa52f None admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:15.791917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442ebce-92b4-4f33-8b2b-4adf8d5fa52f None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:15.792196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442ebce-92b4-4f33-8b2b-4adf8d5fa52f None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/166a670867884c689f3dd5c93b58b97f/roles/ba228abac44e4f3488f5341a608803f3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:15.806244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442ebce-92b4-4f33-8b2b-4adf8d5fa52f None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=166a670867884c689f3dd5c93b58b97f, role_id=ba228abac44e4f3488f5341a608803f3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:15.807710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442ebce-92b4-4f33-8b2b-4adf8d5fa52f None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:16.007702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 625/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:32:15 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/166a670867884c689f3dd5c93b58b97f/roles/ba228abac44e4f3488f5341a608803f3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:32:18.250852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270ae1-6a27-4608-b80e-4ad8a192e096 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:18.251389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270ae1-6a27-4608-b80e-4ad8a192e096 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:18.251389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32270ae1-6a27-4608-b80e-4ad8a192e096 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:18.252711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 608/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:18.258380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:18.258829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:18.258923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:18.276339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:18.277511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:18.341913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 626/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:18.365639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32270ae1-6a27-4608-b80e-4ad8a192e096 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:18.462097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32270ae1-6a27-4608-b80e-4ad8a192e096 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:18.499100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:18.499908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:18.500186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:18.500454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:18.510376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:32:18.518183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:18.519494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:18.520617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 609/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue May 3 22:32:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:18.525629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:18.620051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8782cf-d0c5-478d-81ae-ec1ebf27810f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:18.652124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:18.652769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:18.653044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:18.653315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:18.654048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:18.654346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:18.655759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:18.663709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 627/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue May 3 22:32:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:18.669442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:18.774624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c24b7f-0afc-4273-a6b6-38ff21a3d0bc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:18.806042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:18.806813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:18.807087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:18.807382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:18.817583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:18.819086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:18.837049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:18.838140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:18.839263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:18.839263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:18.839263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:18.839263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:18.839263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 610/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:18.844036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:18.938913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a83c6-2a65-4944-b084-4bb9b38af1d5 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:18.971091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:18.971784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:18.972426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:18.972426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:18.973058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:18.973366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:18.974733 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:18.986985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 628/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:18.992949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:19.090076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6d24f-1151-476a-842f-ed7c38c07385 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:19.121714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:19.122505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:19.122788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:19.123064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:19.130205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:19.132183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:32:19.146258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:19.147906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:19.149010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 611/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:19.154091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:19.247319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cac6b-0d8d-4f67-8ea9-47fbe251605e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:19.280362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:19.281014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:19.281291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:19.281558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:19.282371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:19.282672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:19.284149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:19.300311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 629/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 22:32:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:32:19.306179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:19.402832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0952ada-02c5-4bb7-93b4-face8fa3e30b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:19.434467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:19.435097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:19.435374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:19.435674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:19.499072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:19.500560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:19.592702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 612/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:32:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:32:19.598512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:19.692619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572acd-ccba-4a77-847b-b5bdb14824ce None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:19.724941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:19.725738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:19.726012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:19.726279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:19.735742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:19.741403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:19.755012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:19.756069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:19.757617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:19.757617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:19.757617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:19.757617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:19.757617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 630/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:19.762455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:19.854150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6c75-6dac-4fd9-8f7a-1dd44a1a85f2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:19.885692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:19.886338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:19.886618 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:19.886890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:19.887599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:19.887937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:19.889305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:19.900920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 613/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:19.906898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:20.004293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e45354-0bf7-4bde-bcaa-d8adab3e354e None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:20.036655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:20.037430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:20.038233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:20.038547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:20.045091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:20.046566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:32:20.060484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:20.061407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:20.062403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 631/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:20.067854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:20.163397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0a5b3-aa33-410b-9378-94c24a6f8a99 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:20.194382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:20.195026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:20.195305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:20.195577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:20.196388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:20.196691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:20.198108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b79b-2555-4182-9274-081a5e2748cd None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:20.209452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 614/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:32:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:20.216275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:20.311235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967644c-465c-484f-97a6-7038cccb98fe None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:20.342675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:20.343310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:20.343592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:20.343901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:20.344717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] RBAC: Adding query filter params (role.id=ba228abac44e4f3488f5341a608803f3, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=166a670867884c689f3dd5c93b58b97f) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:20.345025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:20.346438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cae677-d923-49cf-b2fb-19235d06d7e2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:20.352588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 632/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:32:20 2022] GET /identity/v3/role_assignments?user.id=166a670867884c689f3dd5c93b58b97f&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=ba228abac44e4f3488f5341a608803f3 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:22.623242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c10f-3758-4032-b8d2-ce0c03b33bd4 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:22.623832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c10f-3758-4032-b8d2-ce0c03b33bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:22.623832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c10f-3758-4032-b8d2-ce0c03b33bd4 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:22.625174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 615/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:22.630301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:22.630755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:22.630858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:22.648078 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:22.649252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:22.711386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 633/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:22.734472 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c10f-3758-4032-b8d2-ce0c03b33bd4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:22.829986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c10f-3758-4032-b8d2-ce0c03b33bd4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:22.861574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:22.862332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:22.862610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:22.862880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:22.872306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:32:22.879867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:22.880855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:22.882287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 616/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:32:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:22.887435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:22.980658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83122347-65e4-4ecf-bd8e-64b237051270 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:23.012822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:23.013480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:23.013761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:23.014034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:23.014777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:23.015082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:23.016481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:23.025187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 634/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:23.030823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:23.123799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06807d5c-2c29-41b8-9879-a7349b81fa9d None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:23.156450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:23.157206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:23.157483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:23.157754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:23.170615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:23.172100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:23.189487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:23.190624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:23.192231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:23.192231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:23.192231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:23.192231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:23.192231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 617/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:23.197863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:23.291402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd8125-7163-47a4-b581-1abe9f2b4da0 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:23.323696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:23.329445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:23.329445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:23.329445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:23.329445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:23.329445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:23.329445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:23.338421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 635/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:23.344225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:23.439833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7a82-c972-4ea3-9ab4-11e403774c3e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:23.471546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:23.472355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:23.472637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:23.472911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:23.480051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:23.481488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:32:23.495658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:23.501568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:23.502591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 618/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:23.503288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:23.598593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de48f3c-d17f-4fb2-a6c8-2930afe9babc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:23.632267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:23.632968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:23.633191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:23.633463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:23.634288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:23.634594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:23.636048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:23.652584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 636/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 22:32:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:23.658702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:23.753790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d282965-80d6-4de7-98d5-173207b0a4d7 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:23.785391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:23.786034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:23.786314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:23.786589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:23.849333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:23.851209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:23.942138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 619/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:32:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:32:23.947945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:24.042825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce623f-1240-4e9a-b0c0-d445b419f092 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:24.076402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:24.077179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:24.080035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:24.080035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:24.087912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:24.089433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:24.106582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:24.107637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:24.108776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:24.108776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:24.108776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:24.108776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:24.108776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 637/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:24.113646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:24.205870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc27a54-8389-4ae6-bd47-1f0d58cd3dcb None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:24.238018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:24.238655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:24.238930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:24.239245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:24.240111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:24.240414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:24.241791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:24.252436 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 620/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:24.258057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:24.353115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5610821-0b0d-4d2a-ba8d-1b5f1f977ac2 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:24.384938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:24.385709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:24.385989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:24.386269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:24.392887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:24.394321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:32:24.408159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:24.409226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:24.415173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 638/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:24.415828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:24.509313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419db8d-6fd3-4ce3-a0ae-15c257e9a34b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:24.541571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:24.545352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:24.545352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:24.545352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:24.545352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:24.545352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:24.545352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef3bd2-518b-45c5-98c5-37a1ceaa52b8 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:24.557355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 621/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:32:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:24.563443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:24.660495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654aee2-e6b0-4f64-8c09-f0abe4b3e152 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:24.692110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:24.692749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:24.693034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:24.693309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:24.694670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=166a670867884c689f3dd5c93b58b97f) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:24.694981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:24.696438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642a7cf-c276-45bf-b428-fd58cd6a478a None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:24.701634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 639/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:32:24 2022] GET /identity/v3/role_assignments?user.id=166a670867884c689f3dd5c93b58b97f&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=4c81f00224c04152b175b99a19a7b21c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:26.889621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9679-eed7-4320-970a-de69467e10ff None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:26.890155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9679-eed7-4320-970a-de69467e10ff None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:26.890155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9679-eed7-4320-970a-de69467e10ff None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:26.891543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 622/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:26.897448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:26.897882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:26.898080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:26.915973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:26.917131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:26.980100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 640/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:27.001860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9679-eed7-4320-970a-de69467e10ff None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:27.104750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9679-eed7-4320-970a-de69467e10ff None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:27.137052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:27.137837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:27.138114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:27.138386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:27.151983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:32:27.156469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:27.157591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:27.158639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 623/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:27.164615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:27.260290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef63c3-ebff-4ec6-b679-d6ee7d3f1efe None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:27.292969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:27.293631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:27.293914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:27.294190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:27.294934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:27.295242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:27.296654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:27.304372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 641/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:27.310412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:27.405773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1185fb-195a-487a-90d5-c179e1503ecd None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:27.444528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:27.445502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:27.445922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:27.446326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:27.457632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:27.464321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:27.475942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:27.476973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:27.477997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:27.477997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:27.477997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:27.477997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:27.477997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 624/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:27.482909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:27.578791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22698a-d565-4964-8bb2-3b11214baa36 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:27.611124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:27.611800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:27.612077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:27.612343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:27.613056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:27.613356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:27.614702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:27.626109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 642/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:27.632297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:27.727506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefe95-9a4f-4a6c-af41-c9239f6eea60 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:27.768223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:27.769019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:27.769298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:27.769569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:27.777020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:27.778445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:32:27.792830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:27.793954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:27.795121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 625/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:27.800130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:27.895260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649378b0-f9f1-4a80-88bb-41b2932319a5 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:27.926909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:27.927563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:27.927871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:27.928146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:27.929497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:27.929803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:27.931213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:27.948144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 643/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:27.953926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:28.050662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98758cd-c01e-4474-8772-f32b966e8280 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:28.083953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:28.084766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:28.085049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:28.085323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:28.095361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:28.096909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:28.113776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:28.114839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:28.116082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:28.116082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:28.116082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:28.116082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:28.116082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 626/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:28.121273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:28.214391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854011d-653c-4f79-8593-e52e4648e981 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:28.246814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:28.247459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:28.247770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:28.248044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:28.248751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:28.249052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:28.250401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:28.261186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 644/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:28.266741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:28.363047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5548b8-6c22-4be7-882b-109393bd9648 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:28.395930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:28.396710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:28.397511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:28.397784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:28.404195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:28.405765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:32:28.420071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:28.421205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:28.422490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 627/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:28.427069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:28.521453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e5598-71a1-490b-8ed2-2f49907160b3 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:28.555051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:28.555764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:28.556050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:28.556351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:28.557134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:28.557444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:28.558880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451572b-ae81-474c-bd70-b5dec27e9d15 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:28.571849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 645/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:28.577987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:28.674045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e082a3-9b14-457a-81c7-6cf079a13539 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:28.706517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3406-c4ef-45be-ae5d-93aaf07cbe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:28.707489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3406-c4ef-45be-ae5d-93aaf07cbe74 None admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:28.707804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3406-c4ef-45be-ae5d-93aaf07cbe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:28.708080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3406-c4ef-45be-ae5d-93aaf07cbe74 None admin] PATH_INFO: `/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/166a670867884c689f3dd5c93b58b97f/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:28.710007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3406-c4ef-45be-ae5d-93aaf07cbe74 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fb1ca1c708d4ac6a6e61018246d47d0, user_id=166a670867884c689f3dd5c93b58b97f, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:28.711424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3406-c4ef-45be-ae5d-93aaf07cbe74 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:28.862065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 628/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue May 3 22:32:28 2022] PUT /identity/v3/projects/9fb1ca1c708d4ac6a6e61018246d47d0/users/166a670867884c689f3dd5c93b58b97f/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:32:31.085795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d2ea-3786-4508-bf09-f85226cdb289 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.086333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d2ea-3786-4508-bf09-f85226cdb289 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.086333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759d2ea-3786-4508-bf09-f85226cdb289 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.087710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 646/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:31.092684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.093103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.093219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.109662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:31.110844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:31.172603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 629/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:31.195793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759d2ea-3786-4508-bf09-f85226cdb289 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:31.300226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759d2ea-3786-4508-bf09-f85226cdb289 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:31.332304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:31.333080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.333360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.333630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.343732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(role_id) May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 03 22:32:31.351261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:31.352382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:31.353578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 647/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue May 3 22:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:31.358424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:31.453744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385454e-fe08-474a-91b7-59c6e8d05fa4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:31.484789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:31.485447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.485724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.486003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.486747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:31.487051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:31.488438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:31.496748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 630/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue May 3 22:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:31.502518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:31.597326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870585aa-ae42-4c44-9fcc-a4e1c40d2efc None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:31.628718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:31.629482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.629757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.630024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.640823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:31.642266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:31.658753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:31.659849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:31.660827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:31.660827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:31.660827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:31.660827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:31.660827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 648/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:31.665627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:31.764003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cecdd3-b60e-4eec-ac9b-026bd9c3d460 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:31.795937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:31.796586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.796867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.797139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.797851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:31.798222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:31.799584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:31.811373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 631/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:31.816947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:31.911140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8106e-4e2a-4ba4-bc00-c21ee71f37e6 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:31.944331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:31.945112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:31.945390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:31.945660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:31.952825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:31.954236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_user(user_id) May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 03 22:32:31.967852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:31.969010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:31.970027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 649/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:31.975564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:32.070140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53e7d4-9fc1-40e6-a9be-c2543888bb4e None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:32.101650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:32.102300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:32.108397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:32.108397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:32.108397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:32.108397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:32.108397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:32.121909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 632/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue May 3 22:32:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:32.127689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:32.222047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0a04c-9ff6-4b3f-b71f-94700696f482 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:32.253642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:32.254267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:32.254542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:32.254819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:32.318424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:32.319904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:32.413925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 650/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue May 3 22:32:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 03 22:32:32.419686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:32.513711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071592-dcc2-4d62-a3cd-33e990a74dbc None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:32.547183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:32.547980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:32.548254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:32.548520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:32.558148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:32.559663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 03 22:32:32.576792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:32.577901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:32.579160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 03 22:32:32.579160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 03 22:32:32.579160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 03 22:32:32.579160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:32.579160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 633/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:32.583634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:32.679448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788cc5c-110d-47f1-903c-15fa09275352 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:32.711466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:32.712184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:32.714226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:32.714226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:32.714226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:32.714226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:32.715200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:32.729073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 651/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue May 3 22:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:32.734826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:32.829326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3a6b2-1cbd-4033-bd37-cc5c90ced90b None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:32.861524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:32.862303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:32.862585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:32.862859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:32.869782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:32.871219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(project_id) May 03 22:32:32.884642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application with Lock( May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:32.885569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: ERROR keystone.server.flask.application May 03 22:32:32.886474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 634/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue May 3 22:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:32.891807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:32.989814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d761b3-98d2-430d-828d-824c2a4ade3c None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:33.022230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:33.022873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:33.023149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:33.023423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:33.024232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:33.024537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:33.025967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d509b25-7aff-401f-b48f-37ca743dd252 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:33.037374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 652/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue May 3 22:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:33.047373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:33.144313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93471-e09b-44e2-9bbe-c70202593ab2 None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:33.175371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:33.176031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:33.176315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:33.176589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:33.177409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] RBAC: Adding query filter params (role.id=4c81f00224c04152b175b99a19a7b21c, scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0, user.id=166a670867884c689f3dd5c93b58b97f) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:33.177728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:33.179706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17496bdf-7cf1-4757-86ba-13bb76948625 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:33.185309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 635/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue May 3 22:32:33 2022] GET /identity/v3/role_assignments?user.id=166a670867884c689f3dd5c93b58b97f&scope.project.id=9fb1ca1c708d4ac6a6e61018246d47d0&role.id=4c81f00224c04152b175b99a19a7b21c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:35.413828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c24b-3186-497e-ba31-0b6f06d5aebe None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:35.414359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c24b-3186-497e-ba31-0b6f06d5aebe None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:35.414359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3c24b-3186-497e-ba31-0b6f06d5aebe None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:35.415779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 653/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:35.420790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:35.421188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:35.421339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:35.437514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:35.438694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:35.501784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 636/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:35.524153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c24b-3186-497e-ba31-0b6f06d5aebe None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:35.619703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3c24b-3186-497e-ba31-0b6f06d5aebe None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:35.652303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:35.653080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:35.653357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:35.653622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:35.654266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:35.655672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:35.667097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:35.668326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:35.669461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 654/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:32:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:35.674671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:35.768831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc391b-7f07-4f1e-8261-f6a643212ca8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:35.801271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:35.801918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:35.802201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:35.802478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:35.803179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:35.803485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:35.804888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88453b3-2597-44ed-8485-d9565495a6e2 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:35.809491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 637/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 22:32:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:35.815316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:35.910964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cf41b-2f8c-459c-9990-f243692d7356 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:35.942870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:35.943455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:35.943831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:35.944605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] PATH_INFO: `/v3/services` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:35.945308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:35.945617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:35.947105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d56f67-1c2f-4967-b238-5e39737c6d10 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:35.951344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 655/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 22:32:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:38.200655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5aa8-ba4e-4784-9aaf-e4b75de440d9 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:38.201272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5aa8-ba4e-4784-9aaf-e4b75de440d9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:38.201272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f5aa8-ba4e-4784-9aaf-e4b75de440d9 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:38.202570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 638/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:38.207722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595edd8-c975-4cc9-951e-246ceb5233f2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:38.208149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595edd8-c975-4cc9-951e-246ceb5233f2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:38.208281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595edd8-c975-4cc9-951e-246ceb5233f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:38.225885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2595edd8-c975-4cc9-951e-246ceb5233f2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:38.226997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2595edd8-c975-4cc9-951e-246ceb5233f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:38.291549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 656/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:38.313648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5aa8-ba4e-4784-9aaf-e4b75de440d9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:38.408975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f5aa8-ba4e-4784-9aaf-e4b75de440d9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:38.440509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5c580-e915-45a2-b6f3-b47d39fa362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:38.444362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5c580-e915-45a2-b6f3-b47d39fa362d None admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:38.444362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5c580-e915-45a2-b6f3-b47d39fa362d None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:38.444362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5c580-e915-45a2-b6f3-b47d39fa362d None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:38.444362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5c580-e915-45a2-b6f3-b47d39fa362d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:38.444362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5c580-e915-45a2-b6f3-b47d39fa362d None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:38.548416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 639/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue May 3 22:32:38 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:32:40.795427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd95b-eadf-41ca-9125-3190e18228a6 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:40.796021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd95b-eadf-41ca-9125-3190e18228a6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:40.796021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dd95b-eadf-41ca-9125-3190e18228a6 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:40.797403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 657/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:40.802442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df639-966c-431e-bbf5-ecff52560796 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:40.802864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df639-966c-431e-bbf5-ecff52560796 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:40.802995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df639-966c-431e-bbf5-ecff52560796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:40.819698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-189df639-966c-431e-bbf5-ecff52560796 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:40.828022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-189df639-966c-431e-bbf5-ecff52560796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:40.894830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 640/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 03 22:32:40.923765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd95b-eadf-41ca-9125-3190e18228a6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:41.029089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dd95b-eadf-41ca-9125-3190e18228a6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:41.062171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:41.062888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:41.063162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:41.063428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:41.064104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:41.065488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:41.077087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:41.078362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:41.079597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 658/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:32:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:41.085638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189df639-966c-431e-bbf5-ecff52560796 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:41.184486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189df639-966c-431e-bbf5-ecff52560796 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:41.218366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:41.219020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:41.219295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:41.219563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:41.220297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:41.220592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:41.221948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:41.227158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 641/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 22:32:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:41.233751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:41.333112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b4a5-ae94-4571-a8d0-03d5eb52d6bb None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:41.366370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:41.367021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:41.367315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:41.367571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:41.368384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] RBAC: Adding query filter params (interface=public, service_id=ce2d5481976d4542985b6b7462c5efe4, region_id=RegionOne) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:41.368691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:41.370053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ca68d-0018-420a-a70c-331ce8066ca8 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:41.374866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 659/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue May 3 22:32:41 2022] GET /identity/v3/endpoints?service_id=ce2d5481976d4542985b6b7462c5efe4&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:41.380911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:41.481550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae04cb-a49f-445b-ad58-e7d1e90e0fcf None admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:41.519816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afee35-2b5e-47a4-b649-abecd1191a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:41.521407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afee35-2b5e-47a4-b649-abecd1191a45 None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:41.521696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afee35-2b5e-47a4-b649-abecd1191a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:41.522490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afee35-2b5e-47a4-b649-abecd1191a45 None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:41.523172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afee35-2b5e-47a4-b649-abecd1191a45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:41.524945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afee35-2b5e-47a4-b649-abecd1191a45 None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:41.531746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 642/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue May 3 22:32:41 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:32:43.776655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052278-925c-41e4-bd14-4e2cc4e251b0 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:43.777249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052278-925c-41e4-bd14-4e2cc4e251b0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:43.777249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38052278-925c-41e4-bd14-4e2cc4e251b0 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:43.778563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 660/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:32:43.783570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:43.784014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:43.784160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:43.801083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:32:43.802263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:32:43.865466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 643/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:32:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 03 22:32:43.888769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38052278-925c-41e4-bd14-4e2cc4e251b0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:43.986322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38052278-925c-41e4-bd14-4e2cc4e251b0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:44.019197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:44.020024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:44.020308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:44.020586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:44.021232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:44.022615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application Traceback (most recent call last): May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 03 22:32:44.034347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._get_service(service_id) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 03 22:32:44.035530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.get_or_create( May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application with Lock( May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self._enter() May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application return self.creator() May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application created_value = creator( May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: ERROR keystone.server.flask.application May 03 22:32:44.036487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 661/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue May 3 22:32:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 03 22:32:44.042048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:44.135829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e873a1-b62c-4d09-a7d1-528b9c566000 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:44.168739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:44.169378 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:44.169654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:44.169923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] PATH_INFO: `/v3/services` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:44.170614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:32:44.170912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:44.172291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d9174-bec0-4269-bcfb-0e942482c81a None admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:44.177373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 644/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue May 3 22:32:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:32:44.183258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:32:44.278814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f187-3826-441d-9452-bfa5b757ee85 None admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:32:44.311071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf1dbc-8b27-4a9e-ba05-7d82adcc30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:32:44.311685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1dbc-8b27-4a9e-ba05-7d82adcc30db None admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:32:44.311969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1dbc-8b27-4a9e-ba05-7d82adcc30db None admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:32:44.312245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf1dbc-8b27-4a9e-ba05-7d82adcc30db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:32:44.312978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf1dbc-8b27-4a9e-ba05-7d82adcc30db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:32:44.314335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf1dbc-8b27-4a9e-ba05-7d82adcc30db None admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:32:44.416785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 662/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue May 3 22:32:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:40:26.169696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3846-7624-47d0-8380-38e3285c314b None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:26.170142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3846-7624-47d0-8380-38e3285c314b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:26.170359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff3846-7624-47d0-8380-38e3285c314b None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:26.172185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 645/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:26.178556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b581-39c5-482f-a717-603c259a7ab3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:26.181263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b581-39c5-482f-a717-603c259a7ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:26.182652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b581-39c5-482f-a717-603c259a7ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:26.285922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ee43b581-39c5-482f-a717-603c259a7ab3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:26.287216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ee43b581-39c5-482f-a717-603c259a7ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:26.434115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 663/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:26.507157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb328-d918-4b24-aec5-b97dbbe54773 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:26.507828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb328-d918-4b24-aec5-b97dbbe54773 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:26.508240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb328-d918-4b24-aec5-b97dbbe54773 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:26.510062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 646/1309] 10.222.0.23 () {54 vars in 964 bytes} [Tue May 3 22:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:40:26.517068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f511f8b-d80f-4f66-8c8c-b121cf131f0b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:26.517605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f511f8b-d80f-4f66-8c8c-b121cf131f0b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:26.518007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f511f8b-d80f-4f66-8c8c-b121cf131f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:26.595249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2f511f8b-d80f-4f66-8c8c-b121cf131f0b None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:26.596645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2f511f8b-d80f-4f66-8c8c-b121cf131f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:26.682351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 664/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Tue May 3 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:26.691146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb328-d918-4b24-aec5-b97dbbe54773 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:26.693170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9aeeb328-d918-4b24-aec5-b97dbbe54773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:26.808830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb328-d918-4b24-aec5-b97dbbe54773 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:26.886676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:26.887597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:26.888018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:26.888393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:26.890548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:27.001979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:27.003516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f217a3-0195-41b7-8c83-af43e010f2ff service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:27.025333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 647/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:29.560664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d548a-dcca-4c27-8fd9-ff9ca318166a None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:29.561170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d548a-dcca-4c27-8fd9-ff9ca318166a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:29.561170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d548a-dcca-4c27-8fd9-ff9ca318166a None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:29.562602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 665/1312] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:29.567797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b35ad-bd9a-4c35-8546-e371c63efcde None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:29.568263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b35ad-bd9a-4c35-8546-e371c63efcde None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:29.568369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b35ad-bd9a-4c35-8546-e371c63efcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:29.646390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ee1b35ad-bd9a-4c35-8546-e371c63efcde None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:29.647495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ee1b35ad-bd9a-4c35-8546-e371c63efcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:29.743077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 648/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:29.780446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d548a-dcca-4c27-8fd9-ff9ca318166a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:29.782723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6f8d548a-dcca-4c27-8fd9-ff9ca318166a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:29.882623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d548a-dcca-4c27-8fd9-ff9ca318166a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:29.954993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:29.955669 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:29.955955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:29.956270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:29.957917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:30.067879 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:30.069318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f25dd-d079-4ae9-8339-10ed5c4a419d service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:30.087757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 666/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:32.919061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725034-2ac1-4851-9d97-ea99c51eeda4 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:32.919642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725034-2ac1-4851-9d97-ea99c51eeda4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:32.919642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c725034-2ac1-4851-9d97-ea99c51eeda4 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:32.920957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 649/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:32.926865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858824cc-f521-4348-a356-e2bdc7a968a3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:32.927302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858824cc-f521-4348-a356-e2bdc7a968a3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:32.927463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858824cc-f521-4348-a356-e2bdc7a968a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:32.990762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-858824cc-f521-4348-a356-e2bdc7a968a3 None None] MFA Rules not processed for user `f93ce690e2b3438bafd9444b82fa2e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:32.992025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-858824cc-f521-4348-a356-e2bdc7a968a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:33.090920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 667/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:33.130939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725034-2ac1-4851-9d97-ea99c51eeda4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:33.132525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7c725034-2ac1-4851-9d97-ea99c51eeda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:33.231565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c725034-2ac1-4851-9d97-ea99c51eeda4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:33.305000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:33.305640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:33.305913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:33.306184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:33.307832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:33.411819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:33.413289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a378d9-5ca4-4a36-b1f8-3f52d84b5e34 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:33.431616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 650/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:36.408488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48d760-7a95-4a33-9881-87589956b0b9 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:36.409020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48d760-7a95-4a33-9881-87589956b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:36.409020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48d760-7a95-4a33-9881-87589956b0b9 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:36.410448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 668/1318] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:36.415743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd271e-e1cf-41c8-9ab8-848150f82e2b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:36.416129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd271e-e1cf-41c8-9ab8-848150f82e2b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:36.416295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd271e-e1cf-41c8-9ab8-848150f82e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:36.482470 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f8cd271e-e1cf-41c8-9ab8-848150f82e2b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:36.483718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f8cd271e-e1cf-41c8-9ab8-848150f82e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:36.576561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 651/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:36.631864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9af7-bfa6-443e-8b5c-bb719fbe21c6 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:36.632150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9af7-bfa6-443e-8b5c-bb719fbe21c6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:36.632452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b9af7-bfa6-443e-8b5c-bb719fbe21c6 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:36.633818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 669/1320] 10.222.0.23 () {54 vars in 964 bytes} [Tue May 3 22:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:36.639809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869c7b-55e2-46dd-b751-ab589324ee1d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:36.640097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869c7b-55e2-46dd-b751-ab589324ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:36.640371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869c7b-55e2-46dd-b751-ab589324ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:36.710933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-46869c7b-55e2-46dd-b751-ab589324ee1d None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:36.712062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-46869c7b-55e2-46dd-b751-ab589324ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:36.793836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 652/1321] 10.222.0.23 () {58 vars in 1061 bytes} [Tue May 3 22:40:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:36.803651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9af7-bfa6-443e-8b5c-bb719fbe21c6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:36.805181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5f8b9af7-bfa6-443e-8b5c-bb719fbe21c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:36.905717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b9af7-bfa6-443e-8b5c-bb719fbe21c6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:36.976312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:36.976959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:36.977239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:36.977518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:36.979275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:37.084716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:37.086137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec9a58-3325-4ef9-95d9-081f44c5019e service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:37.103629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 670/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:40.832398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4a5de-2c94-4958-abc0-05bd10bb4046 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:40.832941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4a5de-2c94-4958-abc0-05bd10bb4046 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:40.832941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4a5de-2c94-4958-abc0-05bd10bb4046 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:40.834364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 653/1323] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:40.839688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeace8-179a-4f12-97e0-138dbb60abae None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:40.840128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeace8-179a-4f12-97e0-138dbb60abae None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:40.840396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeace8-179a-4f12-97e0-138dbb60abae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:40.903215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b8aeace8-179a-4f12-97e0-138dbb60abae None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:40.904462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b8aeace8-179a-4f12-97e0-138dbb60abae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:40.998050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 671/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:41.033826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4a5de-2c94-4958-abc0-05bd10bb4046 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:41.035343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-89f4a5de-2c94-4958-abc0-05bd10bb4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:41.149535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4a5de-2c94-4958-abc0-05bd10bb4046 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:41.220402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:41.221166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:41.221448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:41.221717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:41.223341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:41.326411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:41.327879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03106b0-494b-4b55-8253-66dd3dfe2ed8 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:41.345918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 654/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:40:43.642816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070729-2ec1-4956-9101-fa58dcba495b None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:43.643357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070729-2ec1-4956-9101-fa58dcba495b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:43.643357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070729-2ec1-4956-9101-fa58dcba495b None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:43.644786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 672/1326] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:43.650234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916b6d7-c6e2-4a99-8b9d-8153fa2cd5ee None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:43.651762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916b6d7-c6e2-4a99-8b9d-8153fa2cd5ee None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:43.651762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916b6d7-c6e2-4a99-8b9d-8153fa2cd5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:43.715633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b916b6d7-c6e2-4a99-8b9d-8153fa2cd5ee None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:43.716916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b916b6d7-c6e2-4a99-8b9d-8153fa2cd5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:43.811544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 655/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:43.848681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb070729-2ec1-4956-9101-fa58dcba495b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:43.850218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fb070729-2ec1-4956-9101-fa58dcba495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:43.948993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb070729-2ec1-4956-9101-fa58dcba495b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:44.019340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:44.020031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:44.020312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:44.020585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:44.022208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:44.127382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:44.128872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22466995-c042-4510-a735-a2686052ec5b service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:44.146623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 673/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:46.472414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c1fe-2fe2-4cb9-b332-a26687502a1f None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:46.472974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c1fe-2fe2-4cb9-b332-a26687502a1f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:46.472974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39c1fe-2fe2-4cb9-b332-a26687502a1f None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:46.474377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 656/1329] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:46.479689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c73ed-57dc-4aac-8d96-2b978d1ece31 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:46.480077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c73ed-57dc-4aac-8d96-2b978d1ece31 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:46.480254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c73ed-57dc-4aac-8d96-2b978d1ece31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:46.544478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1d4c73ed-57dc-4aac-8d96-2b978d1ece31 None None] MFA Rules not processed for user `f93ce690e2b3438bafd9444b82fa2e00`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:46.545686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1d4c73ed-57dc-4aac-8d96-2b978d1ece31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:46.638820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 674/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:46.676686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c1fe-2fe2-4cb9-b332-a26687502a1f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:46.678270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ff39c1fe-2fe2-4cb9-b332-a26687502a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:46.777451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39c1fe-2fe2-4cb9-b332-a26687502a1f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:46.861480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:46.862123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:46.862406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:46.862683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:46.866151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:46.971374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:46.972846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bfaea-8c1b-4252-a151-53f42f6a2c62 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:46.990773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 657/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:49.677787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769dd3e-d8aa-4935-bd08-4d58d85c076b None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:49.678279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769dd3e-d8aa-4935-bd08-4d58d85c076b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:49.678363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769dd3e-d8aa-4935-bd08-4d58d85c076b None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:49.683152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 675/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:49.685204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604eec-a522-4d5c-b8b7-8cc24d56050e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:49.685646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604eec-a522-4d5c-b8b7-8cc24d56050e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:49.685818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36604eec-a522-4d5c-b8b7-8cc24d56050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:49.752440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-36604eec-a522-4d5c-b8b7-8cc24d56050e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:49.753665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-36604eec-a522-4d5c-b8b7-8cc24d56050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:49.849303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 658/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:49.885822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769dd3e-d8aa-4935-bd08-4d58d85c076b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:49.887336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c769dd3e-d8aa-4935-bd08-4d58d85c076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:50.001510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769dd3e-d8aa-4935-bd08-4d58d85c076b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:50.078394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:50.079378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:50.079876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:50.080322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:50.082175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:50.200825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:50.202381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad16a67-3077-49fd-a4a1-d7bfa62d0e91 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:50.221679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 676/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:52.675392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61a326-5dff-4497-87eb-50d5065e80b5 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:52.675998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61a326-5dff-4497-87eb-50d5065e80b5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:52.675998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61a326-5dff-4497-87eb-50d5065e80b5 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:52.677334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 659/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:52.682366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfe09-257b-42c4-a9a9-8cc4b58632e0 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:52.682792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfe09-257b-42c4-a9a9-8cc4b58632e0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:52.682918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfe09-257b-42c4-a9a9-8cc4b58632e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:52.744528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f29bfe09-257b-42c4-a9a9-8cc4b58632e0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:52.745697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f29bfe09-257b-42c4-a9a9-8cc4b58632e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:52.836842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 677/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:52.876337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61a326-5dff-4497-87eb-50d5065e80b5 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:52.877858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4e61a326-5dff-4497-87eb-50d5065e80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:52.976894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61a326-5dff-4497-87eb-50d5065e80b5 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:53.046506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:53.047166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:53.047441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:53.047740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:53.049352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:53.152783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:53.154248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e183-482e-4ef8-986c-520145b3dff2 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:53.173249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 660/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:40:56.102401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45417ede-6ff4-476f-a643-26232f2d30a8 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:56.102978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45417ede-6ff4-476f-a643-26232f2d30a8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:56.102978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45417ede-6ff4-476f-a643-26232f2d30a8 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:56.104359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 678/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:40:56.110000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dffd3-093e-4414-89b4-87ee1a8fb6da None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:56.110396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dffd3-093e-4414-89b4-87ee1a8fb6da None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:56.110552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15dffd3-093e-4414-89b4-87ee1a8fb6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:56.178977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b15dffd3-093e-4414-89b4-87ee1a8fb6da None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:40:56.180115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b15dffd3-093e-4414-89b4-87ee1a8fb6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:56.270908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 661/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:40:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:40:56.306241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45417ede-6ff4-476f-a643-26232f2d30a8 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:40:56.309266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-45417ede-6ff4-476f-a643-26232f2d30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:56.414874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45417ede-6ff4-476f-a643-26232f2d30a8 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:40:56.428807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:40:56.429496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:40:56.429731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:40:56.430005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:40:56.431978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:40:56.543552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:40:56.545026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16828125-f06d-43e2-b675-255a7036ea5f service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:40:56.564020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 679/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:40:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:00.970767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d0cbf-7acf-4f34-be3a-91efbf151c0d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:00.971341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d0cbf-7acf-4f34-be3a-91efbf151c0d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:00.971341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d0cbf-7acf-4f34-be3a-91efbf151c0d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:00.973035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 662/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:00.979519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396d95f-7f5d-48ef-9981-810c4a9bde91 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:00.981492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396d95f-7f5d-48ef-9981-810c4a9bde91 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:00.981492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396d95f-7f5d-48ef-9981-810c4a9bde91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:01.028768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8396d95f-7f5d-48ef-9981-810c4a9bde91 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:01.029968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8396d95f-7f5d-48ef-9981-810c4a9bde91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:01.104074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 680/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:01.143155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d0cbf-7acf-4f34-be3a-91efbf151c0d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:01.145304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6f0d0cbf-7acf-4f34-be3a-91efbf151c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:01.158868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d0cbf-7acf-4f34-be3a-91efbf151c0d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:01.162342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07c086-939d-48a8-802a-abbfc2544782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:01.162970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07c086-939d-48a8-802a-abbfc2544782 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:01.163263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07c086-939d-48a8-802a-abbfc2544782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:01.163542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07c086-939d-48a8-802a-abbfc2544782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:01.172928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07c086-939d-48a8-802a-abbfc2544782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:01.174368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07c086-939d-48a8-802a-abbfc2544782 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:01.186217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 663/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:04.362786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c624b-3e9e-4a62-8423-cf8215dc0752 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:04.363347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c624b-3e9e-4a62-8423-cf8215dc0752 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:04.363347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c624b-3e9e-4a62-8423-cf8215dc0752 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:04.364720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 681/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:04.369787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dfa3e-6ca7-42be-8d03-c5d2352d362f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:04.370200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dfa3e-6ca7-42be-8d03-c5d2352d362f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:04.370362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6dfa3e-6ca7-42be-8d03-c5d2352d362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:04.398280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-be6dfa3e-6ca7-42be-8d03-c5d2352d362f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:04.399464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-be6dfa3e-6ca7-42be-8d03-c5d2352d362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:04.408389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 664/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:04.443565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c624b-3e9e-4a62-8423-cf8215dc0752 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:04.454639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c624b-3e9e-4a62-8423-cf8215dc0752 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:04.458146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e11c7e-232e-4e40-9ffb-d8407aa9e295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:04.458734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11c7e-232e-4e40-9ffb-d8407aa9e295 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:04.459016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11c7e-232e-4e40-9ffb-d8407aa9e295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:04.459287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e11c7e-232e-4e40-9ffb-d8407aa9e295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:04.468135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e11c7e-232e-4e40-9ffb-d8407aa9e295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:04.470139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e11c7e-232e-4e40-9ffb-d8407aa9e295 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:04.479808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 682/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:09.040039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b690-8922-4dbc-9e00-03a363a369ac None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:09.040575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b690-8922-4dbc-9e00-03a363a369ac None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:09.040575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884b690-8922-4dbc-9e00-03a363a369ac None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:09.041963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 665/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:09.047693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b711b8-578a-4f23-9634-1af6866eec55 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:09.048112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b711b8-578a-4f23-9634-1af6866eec55 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:09.048372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b711b8-578a-4f23-9634-1af6866eec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:09.066456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-71b711b8-578a-4f23-9634-1af6866eec55 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:09.067751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-71b711b8-578a-4f23-9634-1af6866eec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:09.075598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 683/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:09.113147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b690-8922-4dbc-9e00-03a363a369ac None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:09.123534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884b690-8922-4dbc-9e00-03a363a369ac None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:09.127029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23005143-bce0-4d3e-b79a-0f40a26c7170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:09.127688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005143-bce0-4d3e-b79a-0f40a26c7170 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:09.127970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005143-bce0-4d3e-b79a-0f40a26c7170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:09.128242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23005143-bce0-4d3e-b79a-0f40a26c7170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:09.136832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005143-bce0-4d3e-b79a-0f40a26c7170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:09.138252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23005143-bce0-4d3e-b79a-0f40a26c7170 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:09.147327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 666/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:14.623696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00686-c809-4a95-9035-dd9ac0aebb09 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:14.624704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00686-c809-4a95-9035-dd9ac0aebb09 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:14.625227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e00686-c809-4a95-9035-dd9ac0aebb09 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:14.626809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 684/1350] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:14.631900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27b9c-7316-4865-8a87-e663b542d788 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:14.632302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27b9c-7316-4865-8a87-e663b542d788 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:14.635431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27b9c-7316-4865-8a87-e663b542d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:14.708538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2db27b9c-7316-4865-8a87-e663b542d788 None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:14.710049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2db27b9c-7316-4865-8a87-e663b542d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:14.797677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 667/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:41:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:19.125152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6dba-b9c1-4de5-b4fa-ef84bb9f6599 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:19.125680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6dba-b9c1-4de5-b4fa-ef84bb9f6599 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:19.125680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b6dba-b9c1-4de5-b4fa-ef84bb9f6599 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:19.127061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 685/1352] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:19.133023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3bfd-da1f-40fd-8c51-dc87f86fdbf0 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:19.133455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3bfd-da1f-40fd-8c51-dc87f86fdbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:19.133571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef3bfd-da1f-40fd-8c51-dc87f86fdbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:19.153843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-43ef3bfd-da1f-40fd-8c51-dc87f86fdbf0 None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:19.155163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-43ef3bfd-da1f-40fd-8c51-dc87f86fdbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:19.164556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 668/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:41:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:20.517538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e02c2-b910-474e-b7cf-86f2e39031e5 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:20.518122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e02c2-b910-474e-b7cf-86f2e39031e5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:20.518227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e02c2-b910-474e-b7cf-86f2e39031e5 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:20.519574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 686/1354] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:20.525126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1aaa5-cb91-4ee4-89e0-58443473d898 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:20.525991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1aaa5-cb91-4ee4-89e0-58443473d898 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:20.526537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1aaa5-cb91-4ee4-89e0-58443473d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:20.549379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d6b1aaa5-cb91-4ee4-89e0-58443473d898 None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:20.550562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d6b1aaa5-cb91-4ee4-89e0-58443473d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:20.559275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 669/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:41:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:24.499235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb444-03f6-454e-b74e-a3faf82af734 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:24.499925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb444-03f6-454e-b74e-a3faf82af734 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:24.500070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb444-03f6-454e-b74e-a3faf82af734 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:24.501695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 687/1356] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:24.506645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1271-9ea2-4161-be1d-d4ffac9e9fe7 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:24.507050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1271-9ea2-4161-be1d-d4ffac9e9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:24.507206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b1271-9ea2-4161-be1d-d4ffac9e9fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:24.525281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ea8b1271-9ea2-4161-be1d-d4ffac9e9fe7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:24.526469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ea8b1271-9ea2-4161-be1d-d4ffac9e9fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:24.535642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 670/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:24.583240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b275ea-8001-400e-9e92-4be64d29409c None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:24.583899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b275ea-8001-400e-9e92-4be64d29409c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:24.584286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b275ea-8001-400e-9e92-4be64d29409c None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:24.585708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 688/1358] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 22:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:24.591256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933326e-5312-47e5-9240-d8b3846f888c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:24.591697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933326e-5312-47e5-9240-d8b3846f888c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:24.592329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933326e-5312-47e5-9240-d8b3846f888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:24.638562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3933326e-5312-47e5-9240-d8b3846f888c None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:24.639883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3933326e-5312-47e5-9240-d8b3846f888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:24.719231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 671/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:24.726863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b275ea-8001-400e-9e92-4be64d29409c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:24.741617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b275ea-8001-400e-9e92-4be64d29409c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:24.747413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c29bcd-4c22-4f33-b6e6-6ace6e2a1e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:24.748080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c29bcd-4c22-4f33-b6e6-6ace6e2a1e0a service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:24.748367 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c29bcd-4c22-4f33-b6e6-6ace6e2a1e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:24.748641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c29bcd-4c22-4f33-b6e6-6ace6e2a1e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:24.757585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c29bcd-4c22-4f33-b6e6-6ace6e2a1e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:24.759130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c29bcd-4c22-4f33-b6e6-6ace6e2a1e0a service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:24.771782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 689/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:27.249137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe67e-43d0-4723-a2b1-22b680886854 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:27.250019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe67e-43d0-4723-a2b1-22b680886854 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:27.250306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe67e-43d0-4723-a2b1-22b680886854 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:27.255348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 672/1361] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:27.256823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dadc5f-fd09-4dcd-921b-23327aa20ce9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:27.257247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dadc5f-fd09-4dcd-921b-23327aa20ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:27.257379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dadc5f-fd09-4dcd-921b-23327aa20ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:27.274861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-46dadc5f-fd09-4dcd-921b-23327aa20ce9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:27.276204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-46dadc5f-fd09-4dcd-921b-23327aa20ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:27.284865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 690/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:41:27.328688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe67e-43d0-4723-a2b1-22b680886854 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:27.344262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe67e-43d0-4723-a2b1-22b680886854 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:27.349675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55551dc2-021b-4813-8e79-3d8805aa763e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:27.350315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55551dc2-021b-4813-8e79-3d8805aa763e service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:27.350607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55551dc2-021b-4813-8e79-3d8805aa763e service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:27.350886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55551dc2-021b-4813-8e79-3d8805aa763e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:27.359942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55551dc2-021b-4813-8e79-3d8805aa763e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:27.361540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55551dc2-021b-4813-8e79-3d8805aa763e service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:27.375195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 673/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:30.075582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d39fa-64ea-4c3c-a32f-b52291631a7b None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:30.076117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d39fa-64ea-4c3c-a32f-b52291631a7b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:30.076212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d39fa-64ea-4c3c-a32f-b52291631a7b None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:30.077696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 691/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:30.082889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8cc7-8175-4d70-a7c7-40c9550eb679 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:30.083269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8cc7-8175-4d70-a7c7-40c9550eb679 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:30.083389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8cc7-8175-4d70-a7c7-40c9550eb679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:30.101281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bfea8cc7-8175-4d70-a7c7-40c9550eb679 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:30.102434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bfea8cc7-8175-4d70-a7c7-40c9550eb679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:30.110826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 674/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:30.154708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873aefa-c300-4df9-b1f2-b0259929c7c8 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:30.154995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873aefa-c300-4df9-b1f2-b0259929c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:30.155273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873aefa-c300-4df9-b1f2-b0259929c7c8 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:30.157278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 692/1366] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 22:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:30.162477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6595d-5f83-4f47-b279-0826e73fd2a8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:30.162759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6595d-5f83-4f47-b279-0826e73fd2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:30.163033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6595d-5f83-4f47-b279-0826e73fd2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:30.181097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-00c6595d-5f83-4f47-b279-0826e73fd2a8 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:30.182202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-00c6595d-5f83-4f47-b279-0826e73fd2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:30.191200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 675/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:41:30.198672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873aefa-c300-4df9-b1f2-b0259929c7c8 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:30.212941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873aefa-c300-4df9-b1f2-b0259929c7c8 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:30.218993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6cb70-ca41-492d-ad6d-efabd70bf081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:30.219724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6cb70-ca41-492d-ad6d-efabd70bf081 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:30.220081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6cb70-ca41-492d-ad6d-efabd70bf081 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:30.220427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6cb70-ca41-492d-ad6d-efabd70bf081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:30.228551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6cb70-ca41-492d-ad6d-efabd70bf081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:30.230130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6cb70-ca41-492d-ad6d-efabd70bf081 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:30.240169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 693/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:32.787998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd031a-c05c-43fa-9c9f-38f9cfab0461 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:32.788524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd031a-c05c-43fa-9c9f-38f9cfab0461 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:32.788524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd031a-c05c-43fa-9c9f-38f9cfab0461 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:32.789844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 676/1369] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:32.795635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:32.796201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:32.796326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:32.798698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683984-de18-4908-a203-2bc621ddabf0 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:32.799217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683984-de18-4908-a203-2bc621ddabf0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:32.799695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683984-de18-4908-a203-2bc621ddabf0 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:32.801263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 677/1370] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:32.806914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03652055-7887-4f73-9907-34d91c2e9b61 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:32.807423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03652055-7887-4f73-9907-34d91c2e9b61 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:32.807909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03652055-7887-4f73-9907-34d91c2e9b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:32.814843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:32.816102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:32.825416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 694/1371] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:32.826748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-03652055-7887-4f73-9907-34d91c2e9b61 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:32.828682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-03652055-7887-4f73-9907-34d91c2e9b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:32.836800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 678/1372] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:41:32.880650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:32.894042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443487f1-45c4-4f92-943b-813d6cc86157 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:32.900109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f46dde-e24f-43d4-b8b7-edc5c513963b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:32.900834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f46dde-e24f-43d4-b8b7-edc5c513963b service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:32.901190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f46dde-e24f-43d4-b8b7-edc5c513963b service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:32.901548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f46dde-e24f-43d4-b8b7-edc5c513963b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:32.911537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f46dde-e24f-43d4-b8b7-edc5c513963b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:32.913249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f46dde-e24f-43d4-b8b7-edc5c513963b service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:32.923260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 695/1373] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:33.104625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f076-6614-44c9-bf5e-03665b831a4c None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:33.104912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f076-6614-44c9-bf5e-03665b831a4c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:33.105189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74f076-6614-44c9-bf5e-03665b831a4c None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:33.106553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 679/1374] 10.222.0.23 () {54 vars in 963 bytes} [Tue May 3 22:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:33.111462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f0c3-5a9b-4a21-b060-8f8e60abb46e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:33.121070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f0c3-5a9b-4a21-b060-8f8e60abb46e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:33.121070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f0c3-5a9b-4a21-b060-8f8e60abb46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:33.161132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2876f0c3-5a9b-4a21-b060-8f8e60abb46e None None] MFA Rules not processed for user `5ec2e18cb1804b6f94d646491f8c20c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:33.162317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2876f0c3-5a9b-4a21-b060-8f8e60abb46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:33.223693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 696/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Tue May 3 22:41:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:33.231228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f076-6614-44c9-bf5e-03665b831a4c None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:33.252494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74f076-6614-44c9-bf5e-03665b831a4c None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:33.259630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f9d69-538d-4e54-b109-64b839ae20b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:33.262445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9d69-538d-4e54-b109-64b839ae20b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:33.262956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9d69-538d-4e54-b109-64b839ae20b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:33.263454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f9d69-538d-4e54-b109-64b839ae20b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:33.281462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9d69-538d-4e54-b109-64b839ae20b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:33.284247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f9d69-538d-4e54-b109-64b839ae20b9 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:33.303310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 680/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:35.479429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260d6c-5a07-473e-98c0-fea3304d6eb1 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:35.479972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260d6c-5a07-473e-98c0-fea3304d6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:35.480080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73260d6c-5a07-473e-98c0-fea3304d6eb1 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:35.481381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 697/1377] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:35.487252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220a19f-0c2d-41a9-bc6d-b409c3223f17 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:35.487252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220a19f-0c2d-41a9-bc6d-b409c3223f17 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:35.487733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220a19f-0c2d-41a9-bc6d-b409c3223f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:35.505873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b220a19f-0c2d-41a9-bc6d-b409c3223f17 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:35.507076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b220a19f-0c2d-41a9-bc6d-b409c3223f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:35.518429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 681/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:35.559736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73260d6c-5a07-473e-98c0-fea3304d6eb1 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:35.574764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73260d6c-5a07-473e-98c0-fea3304d6eb1 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:35.581090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b293498-941a-4e30-95eb-472ac43e4e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:35.581728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293498-941a-4e30-95eb-472ac43e4e6f service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:35.582003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293498-941a-4e30-95eb-472ac43e4e6f service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:35.582270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b293498-941a-4e30-95eb-472ac43e4e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:35.590949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b293498-941a-4e30-95eb-472ac43e4e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:35.592638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b293498-941a-4e30-95eb-472ac43e4e6f service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:35.602750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 698/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:38.007642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199213c4-6555-427e-b46b-d349745dcf5b None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:38.008188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199213c4-6555-427e-b46b-d349745dcf5b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:38.008188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199213c4-6555-427e-b46b-d349745dcf5b None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:38.009550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 682/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:41:38.014656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfb736-5a43-43a5-bc7e-1d09c0abff6b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:38.015575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfb736-5a43-43a5-bc7e-1d09c0abff6b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:38.015774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfb736-5a43-43a5-bc7e-1d09c0abff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:38.034044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b9cfb736-5a43-43a5-bc7e-1d09c0abff6b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:38.035240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b9cfb736-5a43-43a5-bc7e-1d09c0abff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:38.043025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 699/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:38.086615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199213c4-6555-427e-b46b-d349745dcf5b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:38.101923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199213c4-6555-427e-b46b-d349745dcf5b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:38.107304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedf3bb-bd89-4d50-8ba5-7fd0f6a72014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:38.108115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedf3bb-bd89-4d50-8ba5-7fd0f6a72014 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:38.108397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedf3bb-bd89-4d50-8ba5-7fd0f6a72014 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:38.108789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedf3bb-bd89-4d50-8ba5-7fd0f6a72014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:38.117130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedf3bb-bd89-4d50-8ba5-7fd0f6a72014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:38.118879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedf3bb-bd89-4d50-8ba5-7fd0f6a72014 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:38.128792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 683/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:40.572849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f88c6-b553-4b39-bb33-44e987085fc3 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:40.573381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f88c6-b553-4b39-bb33-44e987085fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:40.573381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f88c6-b553-4b39-bb33-44e987085fc3 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:40.574758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 700/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:40.580027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a12abd-1b95-414e-8989-6fa916f91084 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:40.580450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a12abd-1b95-414e-8989-6fa916f91084 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:40.580567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a12abd-1b95-414e-8989-6fa916f91084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:40.598670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-98a12abd-1b95-414e-8989-6fa916f91084 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:40.599874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-98a12abd-1b95-414e-8989-6fa916f91084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:40.607646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 684/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:40.649244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f88c6-b553-4b39-bb33-44e987085fc3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:40.664913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f88c6-b553-4b39-bb33-44e987085fc3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:40.670572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4651944-e641-4be1-b6b8-35184c49e74d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:40.671911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651944-e641-4be1-b6b8-35184c49e74d service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:40.672252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651944-e641-4be1-b6b8-35184c49e74d service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:40.672616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4651944-e641-4be1-b6b8-35184c49e74d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:40.681296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4651944-e641-4be1-b6b8-35184c49e74d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:40.683001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4651944-e641-4be1-b6b8-35184c49e74d service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:40.692718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 701/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:43.084468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341a3fa-ef81-4b58-8c97-358af984d573 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:43.085126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341a3fa-ef81-4b58-8c97-358af984d573 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:43.085126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341a3fa-ef81-4b58-8c97-358af984d573 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:43.086438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 685/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:43.092722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395784-4ccb-49f3-946e-a9e90b39f701 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:43.093179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395784-4ccb-49f3-946e-a9e90b39f701 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:43.093422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be395784-4ccb-49f3-946e-a9e90b39f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:43.116323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-be395784-4ccb-49f3-946e-a9e90b39f701 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:43.117956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-be395784-4ccb-49f3-946e-a9e90b39f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:43.129382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 702/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:43.173999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341a3fa-ef81-4b58-8c97-358af984d573 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:43.192498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341a3fa-ef81-4b58-8c97-358af984d573 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:43.199084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ac7a2-c9cc-45cc-b95e-f7493d264c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:43.199970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ac7a2-c9cc-45cc-b95e-f7493d264c0f service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:43.200345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ac7a2-c9cc-45cc-b95e-f7493d264c0f service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:43.200764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ac7a2-c9cc-45cc-b95e-f7493d264c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:43.210998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ac7a2-c9cc-45cc-b95e-f7493d264c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:43.213036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ac7a2-c9cc-45cc-b95e-f7493d264c0f service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:43.224300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 686/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:46.173590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73697-a6b6-40fb-bb6a-1c1cefd75e61 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:46.174153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73697-a6b6-40fb-bb6a-1c1cefd75e61 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:46.174289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73697-a6b6-40fb-bb6a-1c1cefd75e61 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:46.176346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 703/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:46.182968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6455b-ce5e-41e4-b7a7-c97156444efc None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:46.183371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6455b-ce5e-41e4-b7a7-c97156444efc None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:46.183615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6455b-ce5e-41e4-b7a7-c97156444efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:46.205490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-43b6455b-ce5e-41e4-b7a7-c97156444efc None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:46.206980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-43b6455b-ce5e-41e4-b7a7-c97156444efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:46.217231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 687/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:46.261314 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73697-a6b6-40fb-bb6a-1c1cefd75e61 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:46.277204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73697-a6b6-40fb-bb6a-1c1cefd75e61 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:46.283152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5db474-d7ee-4476-a7ca-2c74ac49dce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:46.283794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db474-d7ee-4476-a7ca-2c74ac49dce4 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:46.284142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db474-d7ee-4476-a7ca-2c74ac49dce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:46.284356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5db474-d7ee-4476-a7ca-2c74ac49dce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:46.292552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db474-d7ee-4476-a7ca-2c74ac49dce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:46.294169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5db474-d7ee-4476-a7ca-2c74ac49dce4 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:46.304002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 704/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:48.764044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64051e8b-dfd5-4a2b-81ba-ff148fadaa58 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:48.765158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64051e8b-dfd5-4a2b-81ba-ff148fadaa58 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:48.765158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64051e8b-dfd5-4a2b-81ba-ff148fadaa58 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:48.766465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 688/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:48.771557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d771e-02ed-4081-b676-be1b8ff80a26 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:48.772049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d771e-02ed-4081-b676-be1b8ff80a26 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:48.772157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d771e-02ed-4081-b676-be1b8ff80a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:48.790393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-909d771e-02ed-4081-b676-be1b8ff80a26 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:48.791574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-909d771e-02ed-4081-b676-be1b8ff80a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:48.799441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 705/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:48.843184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64051e8b-dfd5-4a2b-81ba-ff148fadaa58 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:48.857388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64051e8b-dfd5-4a2b-81ba-ff148fadaa58 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:48.862734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c56af-ded6-4140-880e-96a2ff25f00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:48.863363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c56af-ded6-4140-880e-96a2ff25f00a service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:48.863673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c56af-ded6-4140-880e-96a2ff25f00a service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:48.863952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c56af-ded6-4140-880e-96a2ff25f00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:48.871894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c56af-ded6-4140-880e-96a2ff25f00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:48.873464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c56af-ded6-4140-880e-96a2ff25f00a service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:48.883245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 689/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:49.292822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b9007-83d0-466c-98ad-c5795a6141c4 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:49.293112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b9007-83d0-466c-98ad-c5795a6141c4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:49.293389 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b9007-83d0-466c-98ad-c5795a6141c4 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:49.294766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 706/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:49.300529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6916-620d-46ac-a690-7272f68088fc None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:49.300892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6916-620d-46ac-a690-7272f68088fc None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:49.301184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6916-620d-46ac-a690-7272f68088fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:49.319254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-91ef6916-620d-46ac-a690-7272f68088fc None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:49.320470 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-91ef6916-620d-46ac-a690-7272f68088fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:49.328366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 690/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:49.385896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05edd-4f8b-4cfa-bedb-f86df0893f69 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:49.386187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05edd-4f8b-4cfa-bedb-f86df0893f69 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:49.386470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf05edd-4f8b-4cfa-bedb-f86df0893f69 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:49.387866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 707/1397] 10.222.0.23 () {54 vars in 962 bytes} [Tue May 3 22:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:49.392781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f92bf-4e55-4d2e-a6e3-e50188984ab1 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:49.393074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f92bf-4e55-4d2e-a6e3-e50188984ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:49.393395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f92bf-4e55-4d2e-a6e3-e50188984ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:49.441057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-9b3f92bf-4e55-4d2e-a6e3-e50188984ab1 None None] MFA Rules not processed for user `bffce7ed1d0d4606914bc071da22801a`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:49.442239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9b3f92bf-4e55-4d2e-a6e3-e50188984ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:49.500237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 691/1398] 10.222.0.23 () {58 vars in 1059 bytes} [Tue May 3 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:49.507668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05edd-4f8b-4cfa-bedb-f86df0893f69 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:49.518034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf05edd-4f8b-4cfa-bedb-f86df0893f69 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:49.521630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da7e99-bc2a-4b57-8536-66cf67fd34ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:49.522250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7e99-bc2a-4b57-8536-66cf67fd34ab service glance] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:49.522527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7e99-bc2a-4b57-8536-66cf67fd34ab service glance] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:49.522797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da7e99-bc2a-4b57-8536-66cf67fd34ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:49.531935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da7e99-bc2a-4b57-8536-66cf67fd34ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:49.533377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da7e99-bc2a-4b57-8536-66cf67fd34ab service glance] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:49.542855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 708/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:50.110767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012128ed-c8d7-4e83-9500-34c91dbd3508 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:50.111262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012128ed-c8d7-4e83-9500-34c91dbd3508 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:50.111509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012128ed-c8d7-4e83-9500-34c91dbd3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:50.159593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-012128ed-c8d7-4e83-9500-34c91dbd3508 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:50.160772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-012128ed-c8d7-4e83-9500-34c91dbd3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:50.223668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 692/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:41:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:50.268138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a9351-5ec4-40f1-bb88-1faf93944d82 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:50.268630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a9351-5ec4-40f1-bb88-1faf93944d82 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:50.268737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a9351-5ec4-40f1-bb88-1faf93944d82 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:50.270026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 709/1401] 10.222.0.23 () {54 vars in 942 bytes} [Tue May 3 22:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:50.276405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc636-7d6a-445b-a7b6-897638f5666f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:50.276784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc636-7d6a-445b-a7b6-897638f5666f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:50.277143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc636-7d6a-445b-a7b6-897638f5666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:50.324928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7b3dc636-7d6a-445b-a7b6-897638f5666f None None] MFA Rules not processed for user `f7b72281fc3f423094ed8df450d84db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:50.326121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7b3dc636-7d6a-445b-a7b6-897638f5666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:50.395512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 693/1402] 10.222.0.23 () {58 vars in 1039 bytes} [Tue May 3 22:41:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:50.405057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a9351-5ec4-40f1-bb88-1faf93944d82 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:50.418295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a9351-5ec4-40f1-bb88-1faf93944d82 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:50.423780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088d236-2346-4560-bbb3-b0d120e43c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:50.424414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088d236-2346-4560-bbb3-b0d120e43c92 service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:50.424695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088d236-2346-4560-bbb3-b0d120e43c92 service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:50.424966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088d236-2346-4560-bbb3-b0d120e43c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:50.433398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088d236-2346-4560-bbb3-b0d120e43c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:50.437322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088d236-2346-4560-bbb3-b0d120e43c92 service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:50.443584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 710/1403] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:41:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:41:51.292839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aca900-a6da-4fcd-a7c8-68d201e233c8 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:51.293737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aca900-a6da-4fcd-a7c8-68d201e233c8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:51.294016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aca900-a6da-4fcd-a7c8-68d201e233c8 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:51.295409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 694/1404] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:51.301254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501011-d98e-431e-ac50-13cfe309e19c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:51.302073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501011-d98e-431e-ac50-13cfe309e19c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:51.302558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501011-d98e-431e-ac50-13cfe309e19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:51.321692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-38501011-d98e-431e-ac50-13cfe309e19c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:51.323147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-38501011-d98e-431e-ac50-13cfe309e19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:51.331302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 711/1405] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:51.375467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aca900-a6da-4fcd-a7c8-68d201e233c8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:51.393875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aca900-a6da-4fcd-a7c8-68d201e233c8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:51.399453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b7d30-e013-402a-a5ea-1ea941f0180f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:51.400137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7d30-e013-402a-a5ea-1ea941f0180f service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:51.400420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7d30-e013-402a-a5ea-1ea941f0180f service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:51.400695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b7d30-e013-402a-a5ea-1ea941f0180f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:51.410391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b7d30-e013-402a-a5ea-1ea941f0180f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:51.412039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b7d30-e013-402a-a5ea-1ea941f0180f service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:51.422372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 695/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:41:53.883551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799d68-4b03-49c0-99c4-239874325615 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:53.884603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799d68-4b03-49c0-99c4-239874325615 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:53.884947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799d68-4b03-49c0-99c4-239874325615 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:53.887914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 712/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:41:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:41:53.892621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f817086-5251-4742-91a7-4c1e3a3f159d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:53.893636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f817086-5251-4742-91a7-4c1e3a3f159d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:53.897797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f817086-5251-4742-91a7-4c1e3a3f159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:53.924202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8f817086-5251-4742-91a7-4c1e3a3f159d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:41:53.926734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8f817086-5251-4742-91a7-4c1e3a3f159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:41:53.953803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 696/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:41:53.996614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799d68-4b03-49c0-99c4-239874325615 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:41:54.013498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799d68-4b03-49c0-99c4-239874325615 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:41:54.019916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8bf10-4b46-4b26-9bdd-e18a389ecfb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:41:54.020562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8bf10-4b46-4b26-9bdd-e18a389ecfb8 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:41:54.020965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8bf10-4b46-4b26-9bdd-e18a389ecfb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:41:54.021250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8bf10-4b46-4b26-9bdd-e18a389ecfb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:41:54.031894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8bf10-4b46-4b26-9bdd-e18a389ecfb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:41:54.034699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8bf10-4b46-4b26-9bdd-e18a389ecfb8 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:41:54.048136 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 713/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:15.358740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950b3df-4578-48db-98a2-99ba81704d7d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:15.359384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950b3df-4578-48db-98a2-99ba81704d7d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:15.359384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950b3df-4578-48db-98a2-99ba81704d7d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:15.360693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 697/1410] 10.222.0.23 () {54 vars in 918 bytes} [Tue May 3 22:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:15.365744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b562-9f8f-40cb-83d7-557a7be1751f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:15.366190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b562-9f8f-40cb-83d7-557a7be1751f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:15.366301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0b562-9f8f-40cb-83d7-557a7be1751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:15.383897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3ac0b562-9f8f-40cb-83d7-557a7be1751f None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:15.385099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3ac0b562-9f8f-40cb-83d7-557a7be1751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:15.393433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 714/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 3 22:42:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:42:15.408127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0152d-df8b-4ef7-b6fa-837b1a44d242 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:15.408438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0152d-df8b-4ef7-b6fa-837b1a44d242 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:15.408711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0152d-df8b-4ef7-b6fa-837b1a44d242 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:15.410090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 698/1412] 10.222.0.23 () {54 vars in 918 bytes} [Tue May 3 22:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:15.414486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bd6b-798a-40a6-b269-37f7563529e7 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:15.414773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bd6b-798a-40a6-b269-37f7563529e7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:15.415053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bd6b-798a-40a6-b269-37f7563529e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:15.432680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5e27bd6b-798a-40a6-b269-37f7563529e7 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:15.433857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5e27bd6b-798a-40a6-b269-37f7563529e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:15.442676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 715/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Tue May 3 22:42:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:18.133560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedf3a6-47a7-4ff5-b07d-150a3afa51df None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:18.134122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedf3a6-47a7-4ff5-b07d-150a3afa51df None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:18.134122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedf3a6-47a7-4ff5-b07d-150a3afa51df None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:18.135456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:18.141350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da15b5-90fc-4436-85f9-4380f321f200 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:18.141829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da15b5-90fc-4436-85f9-4380f321f200 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:18.141936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da15b5-90fc-4436-85f9-4380f321f200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:18.159060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-22da15b5-90fc-4436-85f9-4380f321f200 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:18.160268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-22da15b5-90fc-4436-85f9-4380f321f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:18.167773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:42:18.212537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedf3a6-47a7-4ff5-b07d-150a3afa51df None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:18.224275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedf3a6-47a7-4ff5-b07d-150a3afa51df None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:18.229825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb294f9-cfba-43b3-b7d8-f3fda9082e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:18.230460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb294f9-cfba-43b3-b7d8-f3fda9082e63 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:18.230741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb294f9-cfba-43b3-b7d8-f3fda9082e63 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:18.231016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb294f9-cfba-43b3-b7d8-f3fda9082e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:18.239235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb294f9-cfba-43b3-b7d8-f3fda9082e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:18.240834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb294f9-cfba-43b3-b7d8-f3fda9082e63 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:18.250559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 700/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:19.549480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c055a-a920-4f9c-a003-bf614c3bef75 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:19.550057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c055a-a920-4f9c-a003-bf614c3bef75 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:19.550057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c055a-a920-4f9c-a003-bf614c3bef75 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:19.551406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:19.556229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c0bd1-cae3-4aca-972e-d445ff800c9e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:19.556641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c0bd1-cae3-4aca-972e-d445ff800c9e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:19.556780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c0bd1-cae3-4aca-972e-d445ff800c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:19.574486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-9c6c0bd1-cae3-4aca-972e-d445ff800c9e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:19.575686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9c6c0bd1-cae3-4aca-972e-d445ff800c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:19.583897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:19.758659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c055a-a920-4f9c-a003-bf614c3bef75 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:19.773374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c055a-a920-4f9c-a003-bf614c3bef75 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:19.779033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b1cce-f7ea-4152-8a8e-d4d63e42e8da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:19.779688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1cce-f7ea-4152-8a8e-d4d63e42e8da service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:19.779975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1cce-f7ea-4152-8a8e-d4d63e42e8da service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:19.780251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b1cce-f7ea-4152-8a8e-d4d63e42e8da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:19.788122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1cce-f7ea-4152-8a8e-d4d63e42e8da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:19.789704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b1cce-f7ea-4152-8a8e-d4d63e42e8da service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:19.798900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 718/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:21.068732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7043365-f4d9-4cf8-b073-e17c302af178 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:21.069295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7043365-f4d9-4cf8-b073-e17c302af178 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:21.069295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7043365-f4d9-4cf8-b073-e17c302af178 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:21.070652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:21.075591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fbd9-4b51-44c6-82b9-6c7d63e6da71 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:21.076080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fbd9-4b51-44c6-82b9-6c7d63e6da71 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:21.076176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5fbd9-4b51-44c6-82b9-6c7d63e6da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:21.094067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a4a5fbd9-4b51-44c6-82b9-6c7d63e6da71 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:21.095251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a4a5fbd9-4b51-44c6-82b9-6c7d63e6da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:21.102965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:21.251466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7043365-f4d9-4cf8-b073-e17c302af178 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:21.265607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7043365-f4d9-4cf8-b073-e17c302af178 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:21.273314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0079960-08b3-4995-a1e3-add850445606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:21.273957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079960-08b3-4995-a1e3-add850445606 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:21.274236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079960-08b3-4995-a1e3-add850445606 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:21.274543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0079960-08b3-4995-a1e3-add850445606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:21.283925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079960-08b3-4995-a1e3-add850445606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:21.285541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0079960-08b3-4995-a1e3-add850445606 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:21.294857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 703/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:22.531138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0ae08-66ae-480a-a892-a8fca0b40c50 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:22.531704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0ae08-66ae-480a-a892-a8fca0b40c50 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:22.531704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0ae08-66ae-480a-a892-a8fca0b40c50 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:22.533100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:22.537954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98449-ba61-4a71-9468-eb52b28ae1e1 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:22.538374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98449-ba61-4a71-9468-eb52b28ae1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:22.538533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df98449-ba61-4a71-9468-eb52b28ae1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:22.556274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7df98449-ba61-4a71-9468-eb52b28ae1e1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:22.557443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7df98449-ba61-4a71-9468-eb52b28ae1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:22.565629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:22.713664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0ae08-66ae-480a-a892-a8fca0b40c50 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:22.728449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0ae08-66ae-480a-a892-a8fca0b40c50 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:22.734414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af6d84-a8f0-4353-8284-1ff92aa92446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:22.735038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af6d84-a8f0-4353-8284-1ff92aa92446 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:22.735317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af6d84-a8f0-4353-8284-1ff92aa92446 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:22.735590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af6d84-a8f0-4353-8284-1ff92aa92446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:22.743454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af6d84-a8f0-4353-8284-1ff92aa92446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:22.745065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af6d84-a8f0-4353-8284-1ff92aa92446 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:22.754450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 721/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:23.992840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe068-36f7-4c8d-92db-60559aa8fe96 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:23.993303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe068-36f7-4c8d-92db-60559aa8fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:23.993417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe068-36f7-4c8d-92db-60559aa8fe96 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:23.994804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:24.000304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44288-db23-47f5-90b0-d4f422d6b535 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:24.000732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44288-db23-47f5-90b0-d4f422d6b535 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:24.000894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b44288-db23-47f5-90b0-d4f422d6b535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:24.018617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-34b44288-db23-47f5-90b0-d4f422d6b535 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:24.019843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-34b44288-db23-47f5-90b0-d4f422d6b535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:24.027766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:24.175473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe068-36f7-4c8d-92db-60559aa8fe96 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:24.189532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe068-36f7-4c8d-92db-60559aa8fe96 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:24.194835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692f16b-a6be-4f52-92bc-3bd393f99edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:24.195461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f16b-a6be-4f52-92bc-3bd393f99edd service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:24.195779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f16b-a6be-4f52-92bc-3bd393f99edd service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:24.196058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692f16b-a6be-4f52-92bc-3bd393f99edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:24.207355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692f16b-a6be-4f52-92bc-3bd393f99edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:24.207355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692f16b-a6be-4f52-92bc-3bd393f99edd service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:24.214883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 706/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:25.509754 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de6a6-1005-4b5e-9212-7e0acba107ef None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:25.510293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de6a6-1005-4b5e-9212-7e0acba107ef None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:25.510293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de6a6-1005-4b5e-9212-7e0acba107ef None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:25.511719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:25.517297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc63d-67cc-4a41-ad1c-ebd1df69019f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:25.517729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc63d-67cc-4a41-ad1c-ebd1df69019f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:25.517859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc63d-67cc-4a41-ad1c-ebd1df69019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:25.536437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0b3dc63d-67cc-4a41-ad1c-ebd1df69019f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:25.537644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0b3dc63d-67cc-4a41-ad1c-ebd1df69019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:25.545458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:25.694962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de6a6-1005-4b5e-9212-7e0acba107ef None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:25.710585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de6a6-1005-4b5e-9212-7e0acba107ef None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:25.716417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0acf0-2cb6-46a6-9a5f-8c5a1fdc73da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:25.716993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0acf0-2cb6-46a6-9a5f-8c5a1fdc73da service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:25.717275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0acf0-2cb6-46a6-9a5f-8c5a1fdc73da service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:25.717546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0acf0-2cb6-46a6-9a5f-8c5a1fdc73da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:25.725663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0acf0-2cb6-46a6-9a5f-8c5a1fdc73da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:25.727241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0acf0-2cb6-46a6-9a5f-8c5a1fdc73da service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:25.736393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 724/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:27.022748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26c4d-876b-4d17-aa8b-dfe843f2fc2f None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:27.023276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26c4d-876b-4d17-aa8b-dfe843f2fc2f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:27.023276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e26c4d-876b-4d17-aa8b-dfe843f2fc2f None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:27.024711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:27.030059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3700-67f6-454f-8180-b2e827fa6449 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:27.030496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3700-67f6-454f-8180-b2e827fa6449 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:27.030601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3700-67f6-454f-8180-b2e827fa6449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:27.049132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f66a3700-67f6-454f-8180-b2e827fa6449 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:27.050303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f66a3700-67f6-454f-8180-b2e827fa6449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:27.057939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:27.214438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e26c4d-876b-4d17-aa8b-dfe843f2fc2f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:27.229188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e26c4d-876b-4d17-aa8b-dfe843f2fc2f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:27.235108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1090d-1f29-4f82-a5b6-78268130d5c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:27.235766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1090d-1f29-4f82-a5b6-78268130d5c4 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:27.236048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1090d-1f29-4f82-a5b6-78268130d5c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:27.236319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1090d-1f29-4f82-a5b6-78268130d5c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:27.244220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1090d-1f29-4f82-a5b6-78268130d5c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:27.245784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1090d-1f29-4f82-a5b6-78268130d5c4 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:27.254943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 709/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:28.523679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66aae3-6ce5-4472-b77e-dca4e5905803 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:28.524295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66aae3-6ce5-4472-b77e-dca4e5905803 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:28.524295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66aae3-6ce5-4472-b77e-dca4e5905803 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:28.525603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:28.531312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aad48-a992-4e2d-b450-6bb3c6b1a10c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:28.531746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aad48-a992-4e2d-b450-6bb3c6b1a10c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:28.531899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9aad48-a992-4e2d-b450-6bb3c6b1a10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:28.549342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-9b9aad48-a992-4e2d-b450-6bb3c6b1a10c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:28.550707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9b9aad48-a992-4e2d-b450-6bb3c6b1a10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:28.558578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:28.707121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66aae3-6ce5-4472-b77e-dca4e5905803 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:28.721173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66aae3-6ce5-4472-b77e-dca4e5905803 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:28.726390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc83898-454b-4c8e-b076-6cc4071a679d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:28.727007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83898-454b-4c8e-b076-6cc4071a679d service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:28.727287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83898-454b-4c8e-b076-6cc4071a679d service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:28.727560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc83898-454b-4c8e-b076-6cc4071a679d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:28.735619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc83898-454b-4c8e-b076-6cc4071a679d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:28.745878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc83898-454b-4c8e-b076-6cc4071a679d service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:28.756109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 727/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:30.024266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22b34-9513-4d20-b451-f27c8f3c1c1f None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:30.024832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22b34-9513-4d20-b451-f27c8f3c1c1f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:30.024832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b22b34-9513-4d20-b451-f27c8f3c1c1f None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:30.026172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:30.031541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392e17-d6a2-42c2-84f1-aa99b55a26fd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:30.031967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392e17-d6a2-42c2-84f1-aa99b55a26fd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:30.032159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3392e17-d6a2-42c2-84f1-aa99b55a26fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:30.050394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c3392e17-d6a2-42c2-84f1-aa99b55a26fd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:30.051583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c3392e17-d6a2-42c2-84f1-aa99b55a26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:30.059191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:30.220031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22b34-9513-4d20-b451-f27c8f3c1c1f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:30.234563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b22b34-9513-4d20-b451-f27c8f3c1c1f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:30.240008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eed31-9809-49d9-b9fc-632c4e2f5fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:30.240636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eed31-9809-49d9-b9fc-632c4e2f5fb9 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:30.246844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eed31-9809-49d9-b9fc-632c4e2f5fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:30.246844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eed31-9809-49d9-b9fc-632c4e2f5fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:30.249184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eed31-9809-49d9-b9fc-632c4e2f5fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:30.250772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eed31-9809-49d9-b9fc-632c4e2f5fb9 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:30.260042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 712/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:32.381922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187f8c-2565-4c2b-a178-e57400ab06f8 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:32.382457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187f8c-2565-4c2b-a178-e57400ab06f8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:32.382457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd187f8c-2565-4c2b-a178-e57400ab06f8 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:32.383870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:32.388964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f57b-d3ed-46b4-a992-a2692a150140 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:32.389345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f57b-d3ed-46b4-a992-a2692a150140 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:32.389561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f57b-d3ed-46b4-a992-a2692a150140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:32.407389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-9898f57b-d3ed-46b4-a992-a2692a150140 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:32.408618 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9898f57b-d3ed-46b4-a992-a2692a150140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:32.416296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:32.454479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187f8c-2565-4c2b-a178-e57400ab06f8 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:32.464842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd187f8c-2565-4c2b-a178-e57400ab06f8 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:32.468793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ea44a-4e1e-4382-b269-21f53acc4644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:32.469412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea44a-4e1e-4382-b269-21f53acc4644 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:32.469688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea44a-4e1e-4382-b269-21f53acc4644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:32.469960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ea44a-4e1e-4382-b269-21f53acc4644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:32.478442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ea44a-4e1e-4382-b269-21f53acc4644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:32.479903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ea44a-4e1e-4382-b269-21f53acc4644 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:32.489437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 730/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:34.876487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8990bc-9286-41ae-9328-8646d0cf4299 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:34.877142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8990bc-9286-41ae-9328-8646d0cf4299 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:34.877142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8990bc-9286-41ae-9328-8646d0cf4299 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:34.878449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:34.883740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9c318-9ae7-4e56-a841-3f22970110f1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:34.884187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9c318-9ae7-4e56-a841-3f22970110f1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:34.884296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9c318-9ae7-4e56-a841-3f22970110f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:34.902668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e0b9c318-9ae7-4e56-a841-3f22970110f1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:34.904143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e0b9c318-9ae7-4e56-a841-3f22970110f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:34.912069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:34.949693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8990bc-9286-41ae-9328-8646d0cf4299 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:34.960749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8990bc-9286-41ae-9328-8646d0cf4299 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:34.964193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d311a8-0e75-4e15-ba55-b3602b1e3cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:34.964815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d311a8-0e75-4e15-ba55-b3602b1e3cec service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:34.965092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d311a8-0e75-4e15-ba55-b3602b1e3cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:34.965365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d311a8-0e75-4e15-ba55-b3602b1e3cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:34.974192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d311a8-0e75-4e15-ba55-b3602b1e3cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:34.975613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d311a8-0e75-4e15-ba55-b3602b1e3cec service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:34.985258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 715/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:37.598908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f9ce-c745-43c1-907a-f0642dc60425 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:37.599485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f9ce-c745-43c1-907a-f0642dc60425 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:37.599485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f9ce-c745-43c1-907a-f0642dc60425 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:37.600905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:37.606104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336e22d-d895-4e6d-af38-1843af90e164 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:37.606545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336e22d-d895-4e6d-af38-1843af90e164 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:37.606653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336e22d-d895-4e6d-af38-1843af90e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:37.624368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7336e22d-d895-4e6d-af38-1843af90e164 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:37.625554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7336e22d-d895-4e6d-af38-1843af90e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:37.633252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:37.671244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f9ce-c745-43c1-907a-f0642dc60425 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:37.682161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f9ce-c745-43c1-907a-f0642dc60425 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:37.685680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4456f7-4f2b-4759-8982-8ed7ea511f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:37.686810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4456f7-4f2b-4759-8982-8ed7ea511f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:37.687074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4456f7-4f2b-4759-8982-8ed7ea511f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:37.687340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4456f7-4f2b-4759-8982-8ed7ea511f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:37.696036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4456f7-4f2b-4759-8982-8ed7ea511f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:37.697454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4456f7-4f2b-4759-8982-8ed7ea511f22 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:37.707072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 733/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:40.044983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8770d68-8fe8-464b-a7ba-172f674d54f5 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:40.045551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8770d68-8fe8-464b-a7ba-172f674d54f5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:40.045551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8770d68-8fe8-464b-a7ba-172f674d54f5 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:40.046957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:40.052056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd160b63-3756-4e62-93d7-d3620b827ed9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:40.052497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd160b63-3756-4e62-93d7-d3620b827ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:40.052640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd160b63-3756-4e62-93d7-d3620b827ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:40.070417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-cd160b63-3756-4e62-93d7-d3620b827ed9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:40.071631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-cd160b63-3756-4e62-93d7-d3620b827ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:40.079921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:40.116770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8770d68-8fe8-464b-a7ba-172f674d54f5 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:40.118401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b8770d68-8fe8-464b-a7ba-172f674d54f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:40.131521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8770d68-8fe8-464b-a7ba-172f674d54f5 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:40.134931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571faa-6eb5-42e6-933c-2308d08e6630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:40.135545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571faa-6eb5-42e6-933c-2308d08e6630 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:40.135850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571faa-6eb5-42e6-933c-2308d08e6630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:40.136117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571faa-6eb5-42e6-933c-2308d08e6630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:40.145232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571faa-6eb5-42e6-933c-2308d08e6630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:40.146637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571faa-6eb5-42e6-933c-2308d08e6630 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:40.156259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 718/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:42.498496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405241-5854-4349-bdc1-54b69d1ed859 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:42.499136 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405241-5854-4349-bdc1-54b69d1ed859 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:42.499393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405241-5854-4349-bdc1-54b69d1ed859 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:42.501192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:42.506334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5971-52bb-49c1-bf6d-cd3df7a23f89 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:42.506742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5971-52bb-49c1-bf6d-cd3df7a23f89 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:42.506889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c5971-52bb-49c1-bf6d-cd3df7a23f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:42.526196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b69c5971-52bb-49c1-bf6d-cd3df7a23f89 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:42.527392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b69c5971-52bb-49c1-bf6d-cd3df7a23f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:42.536613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:42.575876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405241-5854-4349-bdc1-54b69d1ed859 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:42.586745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405241-5854-4349-bdc1-54b69d1ed859 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:42.590194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8b721-c57c-4ecb-8c77-bab36756b8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:42.590811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b721-c57c-4ecb-8c77-bab36756b8ac service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:42.591087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b721-c57c-4ecb-8c77-bab36756b8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:42.591357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b721-c57c-4ecb-8c77-bab36756b8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:42.600482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8b721-c57c-4ecb-8c77-bab36756b8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:42.601902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8b721-c57c-4ecb-8c77-bab36756b8ac service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:42.610881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 736/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:44.983941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274915ce-123b-48ad-832a-752bde3593c7 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:44.984343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274915ce-123b-48ad-832a-752bde3593c7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:44.984506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274915ce-123b-48ad-832a-752bde3593c7 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:44.985889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:44.991380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426a998-efdc-482c-af24-e8498175fe7f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:44.991843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426a998-efdc-482c-af24-e8498175fe7f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:44.991959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426a998-efdc-482c-af24-e8498175fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:45.009170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c426a998-efdc-482c-af24-e8498175fe7f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:45.010351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c426a998-efdc-482c-af24-e8498175fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:45.018480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:42:45.056299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274915ce-123b-48ad-832a-752bde3593c7 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:45.067496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274915ce-123b-48ad-832a-752bde3593c7 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:45.071002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6156cb-6733-431f-b442-328127a4e372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:45.071665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6156cb-6733-431f-b442-328127a4e372 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:45.071974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6156cb-6733-431f-b442-328127a4e372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:45.072252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6156cb-6733-431f-b442-328127a4e372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:45.081544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6156cb-6733-431f-b442-328127a4e372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:45.082965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6156cb-6733-431f-b442-328127a4e372 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:45.092093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 721/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:42:47.386169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6f2c-553f-4440-ae7b-9863dd36f67f None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:47.386729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6f2c-553f-4440-ae7b-9863dd36f67f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:47.386729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6f2c-553f-4440-ae7b-9863dd36f67f None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:47.388158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:47.393252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2696c5-0f91-438f-ac26-562d455dad0d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:47.393656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2696c5-0f91-438f-ac26-562d455dad0d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:47.393803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2696c5-0f91-438f-ac26-562d455dad0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:47.411626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-cc2696c5-0f91-438f-ac26-562d455dad0d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:47.412840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-cc2696c5-0f91-438f-ac26-562d455dad0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:47.420542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:47.457219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d6f2c-553f-4440-ae7b-9863dd36f67f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:47.468063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d6f2c-553f-4440-ae7b-9863dd36f67f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:47.471519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07eeb-bd1d-42ed-aee1-bb73a1105d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:47.472307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07eeb-bd1d-42ed-aee1-bb73a1105d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:47.472587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07eeb-bd1d-42ed-aee1-bb73a1105d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:47.472857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07eeb-bd1d-42ed-aee1-bb73a1105d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:47.481543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07eeb-bd1d-42ed-aee1-bb73a1105d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:47.482970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07eeb-bd1d-42ed-aee1-bb73a1105d95 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:47.492636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 739/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:42:49.779725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc4d6-c318-42ed-a2fc-02bff727a967 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:49.780840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc4d6-c318-42ed-a2fc-02bff727a967 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:49.780840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc4d6-c318-42ed-a2fc-02bff727a967 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:49.782164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:49.787202 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b325fde-2271-4989-9519-06cb17ca4505 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:49.787625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b325fde-2271-4989-9519-06cb17ca4505 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:49.787792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b325fde-2271-4989-9519-06cb17ca4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:49.805453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0b325fde-2271-4989-9519-06cb17ca4505 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:49.806629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0b325fde-2271-4989-9519-06cb17ca4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:49.814306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:49.850960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc4d6-c318-42ed-a2fc-02bff727a967 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:49.862193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc4d6-c318-42ed-a2fc-02bff727a967 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:49.865973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6fe21-99c3-42fa-9d97-6913a15c6545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:49.866600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6fe21-99c3-42fa-9d97-6913a15c6545 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:49.866884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6fe21-99c3-42fa-9d97-6913a15c6545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:49.867161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6fe21-99c3-42fa-9d97-6913a15c6545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:49.875925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6fe21-99c3-42fa-9d97-6913a15c6545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:49.877338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6fe21-99c3-42fa-9d97-6913a15c6545 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:49.886493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 724/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:52.143094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e102-3df2-462a-a8b9-5c9ec3062152 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:52.143676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e102-3df2-462a-a8b9-5c9ec3062152 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:52.143676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184e102-3df2-462a-a8b9-5c9ec3062152 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:52.145025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:52.150261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877b96-a7ee-4cb9-ae2f-487297ac1940 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:52.150676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877b96-a7ee-4cb9-ae2f-487297ac1940 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:52.150824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42877b96-a7ee-4cb9-ae2f-487297ac1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:52.168295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-42877b96-a7ee-4cb9-ae2f-487297ac1940 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:52.169486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-42877b96-a7ee-4cb9-ae2f-487297ac1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:52.177817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:52.213376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e102-3df2-462a-a8b9-5c9ec3062152 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:52.223978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184e102-3df2-462a-a8b9-5c9ec3062152 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:52.227394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e6d19-dd70-40b6-ad68-0fe62f7f52a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:52.228042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e6d19-dd70-40b6-ad68-0fe62f7f52a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:52.228350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e6d19-dd70-40b6-ad68-0fe62f7f52a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:52.228650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e6d19-dd70-40b6-ad68-0fe62f7f52a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:52.237778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e6d19-dd70-40b6-ad68-0fe62f7f52a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:52.239230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e6d19-dd70-40b6-ad68-0fe62f7f52a7 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:52.248249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 742/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:42:54.532402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6774b4-992b-4fc2-816e-c504645d4316 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:54.533003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6774b4-992b-4fc2-816e-c504645d4316 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:54.533003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6774b4-992b-4fc2-816e-c504645d4316 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:54.534381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:42:54.539798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029b26-4612-4388-9536-a76860f40f31 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:54.540230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029b26-4612-4388-9536-a76860f40f31 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:54.540353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029b26-4612-4388-9536-a76860f40f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:54.557437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0c029b26-4612-4388-9536-a76860f40f31 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:42:54.558614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0c029b26-4612-4388-9536-a76860f40f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:42:54.566218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:42:54.602961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6774b4-992b-4fc2-816e-c504645d4316 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:42:54.613441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6774b4-992b-4fc2-816e-c504645d4316 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:42:54.616877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27015d-91a6-4d1d-92aa-e98468b8cf74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:42:54.617492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27015d-91a6-4d1d-92aa-e98468b8cf74 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:42:54.617770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27015d-91a6-4d1d-92aa-e98468b8cf74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:42:54.618040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27015d-91a6-4d1d-92aa-e98468b8cf74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:42:54.627077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27015d-91a6-4d1d-92aa-e98468b8cf74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:42:54.628539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27015d-91a6-4d1d-92aa-e98468b8cf74 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:42:54.637773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 727/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:43:28.057231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea43bf-356d-4617-a2d8-f8dc17b7a0a2 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:28.057801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea43bf-356d-4617-a2d8-f8dc17b7a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:28.057801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea43bf-356d-4617-a2d8-f8dc17b7a0a2 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:28.059171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 744/1471] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:28.064903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65011e-8814-4d4e-b465-8712efc992bd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:28.065315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65011e-8814-4d4e-b465-8712efc992bd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:28.065480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65011e-8814-4d4e-b465-8712efc992bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:28.083810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0b65011e-8814-4d4e-b465-8712efc992bd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:28.084994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0b65011e-8814-4d4e-b465-8712efc992bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:28.092610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 728/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:28.137807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fbdc0-87e7-40f6-bf12-c5d0cbeba914 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:28.138124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fbdc0-87e7-40f6-bf12-c5d0cbeba914 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:28.138397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fbdc0-87e7-40f6-bf12-c5d0cbeba914 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:28.140427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 745/1473] 10.222.0.23 () {54 vars in 962 bytes} [Tue May 3 22:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:28.145802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab73a-b20a-4074-8e88-8578f840c618 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:28.146020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab73a-b20a-4074-8e88-8578f840c618 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:28.146326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ab73a-b20a-4074-8e88-8578f840c618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:28.163772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bb0ab73a-b20a-4074-8e88-8578f840c618 None None] MFA Rules not processed for user `bffce7ed1d0d4606914bc071da22801a`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:28.164950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bb0ab73a-b20a-4074-8e88-8578f840c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:28.171814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 729/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Tue May 3 22:43:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:28.179469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fbdc0-87e7-40f6-bf12-c5d0cbeba914 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:28.190750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fbdc0-87e7-40f6-bf12-c5d0cbeba914 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:28.194157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208436e-1b1e-4aa4-9f2c-11b3b60c8efe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:28.194779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208436e-1b1e-4aa4-9f2c-11b3b60c8efe service glance] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:28.195055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208436e-1b1e-4aa4-9f2c-11b3b60c8efe service glance] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:28.195322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208436e-1b1e-4aa4-9f2c-11b3b60c8efe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:28.204755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208436e-1b1e-4aa4-9f2c-11b3b60c8efe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:28.206248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208436e-1b1e-4aa4-9f2c-11b3b60c8efe service glance] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:28.215518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 746/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:43:30.560230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425def1-4e7f-4f5c-80c8-aa8c95204099 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:30.560805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425def1-4e7f-4f5c-80c8-aa8c95204099 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:30.560805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425def1-4e7f-4f5c-80c8-aa8c95204099 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:30.562257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 730/1476] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:30.567684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd7d2-f17b-4a6d-b18a-e83b920430d2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:30.568100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd7d2-f17b-4a6d-b18a-e83b920430d2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:30.568254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fd7d2-f17b-4a6d-b18a-e83b920430d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:30.586100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ce0fd7d2-f17b-4a6d-b18a-e83b920430d2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:30.587295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ce0fd7d2-f17b-4a6d-b18a-e83b920430d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:30.595716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 747/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:30.618042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425def1-4e7f-4f5c-80c8-aa8c95204099 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:30.630337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425def1-4e7f-4f5c-80c8-aa8c95204099 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:30.634707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:30.635338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:30.635630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:30.635915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:30.636643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:30.638397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:43:30.638397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:43:30.638397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:43:30.640179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d550f0-29a2-48bf-8b39-288a65b25946 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:30.659406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 731/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Tue May 3 22:43:30 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:43:32.942890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23c31-d6d3-46f1-9fb5-387af6e2ee57 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:32.943437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23c31-d6d3-46f1-9fb5-387af6e2ee57 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:32.943566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f23c31-d6d3-46f1-9fb5-387af6e2ee57 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:32.944913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 748/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:32.950091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4914-9272-455f-a622-e029bfb210cb None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:32.950533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4914-9272-455f-a622-e029bfb210cb None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:32.950660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4914-9272-455f-a622-e029bfb210cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:32.969270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-cd8f4914-9272-455f-a622-e029bfb210cb None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:32.970463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-cd8f4914-9272-455f-a622-e029bfb210cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:32.978112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 732/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:33.019138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23c31-d6d3-46f1-9fb5-387af6e2ee57 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:33.034254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f23c31-d6d3-46f1-9fb5-387af6e2ee57 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:33.039800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ca45a-390a-41fe-a1dc-c4a3902d74f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:33.040433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ca45a-390a-41fe-a1dc-c4a3902d74f6 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:33.040715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ca45a-390a-41fe-a1dc-c4a3902d74f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:33.040990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ca45a-390a-41fe-a1dc-c4a3902d74f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:33.049044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ca45a-390a-41fe-a1dc-c4a3902d74f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:33.050621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ca45a-390a-41fe-a1dc-c4a3902d74f6 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:33.059734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 749/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:43:35.481156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4642-954b-4ebe-b561-5b2204519fab None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:35.481710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4642-954b-4ebe-b561-5b2204519fab None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:35.481710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a4642-954b-4ebe-b561-5b2204519fab None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:35.483215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 733/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:35.488459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0bfac-7ad7-4d45-abc6-346b526802ae None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:35.488874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0bfac-7ad7-4d45-abc6-346b526802ae None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:35.489042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0bfac-7ad7-4d45-abc6-346b526802ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:35.506294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c4b0bfac-7ad7-4d45-abc6-346b526802ae None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:35.507489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c4b0bfac-7ad7-4d45-abc6-346b526802ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:35.515745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 750/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:35.551348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4642-954b-4ebe-b561-5b2204519fab None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:35.562300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a4642-954b-4ebe-b561-5b2204519fab None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:35.574892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c0ec8-e955-4ee2-a6ea-5ec358a13352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:35.574892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c0ec8-e955-4ee2-a6ea-5ec358a13352 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:35.574892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c0ec8-e955-4ee2-a6ea-5ec358a13352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:35.574892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c0ec8-e955-4ee2-a6ea-5ec358a13352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:35.577534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c0ec8-e955-4ee2-a6ea-5ec358a13352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:35.578989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c0ec8-e955-4ee2-a6ea-5ec358a13352 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:35.588841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 734/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:43:37.899619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d62470-1c96-49ec-8285-d332a1689692 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:37.900237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d62470-1c96-49ec-8285-d332a1689692 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:37.900237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d62470-1c96-49ec-8285-d332a1689692 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:37.901537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 751/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:37.907481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aee59-75ae-4052-913c-b88c729006f7 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:37.907973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aee59-75ae-4052-913c-b88c729006f7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:37.908079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aee59-75ae-4052-913c-b88c729006f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:37.925178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3a0aee59-75ae-4052-913c-b88c729006f7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:37.926372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3a0aee59-75ae-4052-913c-b88c729006f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:37.934005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 735/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:37.971545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d62470-1c96-49ec-8285-d332a1689692 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:37.982112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d62470-1c96-49ec-8285-d332a1689692 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:37.985601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d862c9-185e-490b-8511-fb9b711ae79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:37.986225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d862c9-185e-490b-8511-fb9b711ae79a service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:37.986511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d862c9-185e-490b-8511-fb9b711ae79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:37.986784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d862c9-185e-490b-8511-fb9b711ae79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:37.995744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d862c9-185e-490b-8511-fb9b711ae79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:37.997177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d862c9-185e-490b-8511-fb9b711ae79a service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:38.006935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 752/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:43:40.425537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630285f-f1de-4976-a9fe-8375214c5cb3 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:40.429133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630285f-f1de-4976-a9fe-8375214c5cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:40.429133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630285f-f1de-4976-a9fe-8375214c5cb3 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:40.429133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 736/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:40.432510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd3ad-1740-4855-9c50-a05c5aa41d52 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:40.432934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd3ad-1740-4855-9c50-a05c5aa41d52 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:40.433043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd3ad-1740-4855-9c50-a05c5aa41d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:40.450642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9a3fd3ad-1740-4855-9c50-a05c5aa41d52 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:40.452472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9a3fd3ad-1740-4855-9c50-a05c5aa41d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:40.460233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 753/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:40.499030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630285f-f1de-4976-a9fe-8375214c5cb3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:40.509695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630285f-f1de-4976-a9fe-8375214c5cb3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:40.514010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811cf0-118c-415a-825a-e5cf1b2a2105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:40.514674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811cf0-118c-415a-825a-e5cf1b2a2105 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:40.519691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811cf0-118c-415a-825a-e5cf1b2a2105 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:40.519691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811cf0-118c-415a-825a-e5cf1b2a2105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:40.524114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811cf0-118c-415a-825a-e5cf1b2a2105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:40.525538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811cf0-118c-415a-825a-e5cf1b2a2105 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:40.535031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 737/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:43:43.129985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ee0c1-185b-4303-ab13-3e5e84c893f5 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:43.130559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ee0c1-185b-4303-ab13-3e5e84c893f5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:43.130559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ee0c1-185b-4303-ab13-3e5e84c893f5 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:43.131945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 754/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue May 3 22:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:43:43.136984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed64ee0-def6-45fe-b030-5519a554ff14 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:43.137367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed64ee0-def6-45fe-b030-5519a554ff14 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:43.137533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed64ee0-def6-45fe-b030-5519a554ff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:43.155720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-eed64ee0-def6-45fe-b030-5519a554ff14 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:43:43.156922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-eed64ee0-def6-45fe-b030-5519a554ff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:43:43.164619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 738/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue May 3 22:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:43:43.202803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ee0c1-185b-4303-ab13-3e5e84c893f5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:43:43.213619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ee0c1-185b-4303-ab13-3e5e84c893f5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:43:43.217138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaae5a-8730-4f23-8e2e-83e0aeff0df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:43:43.217769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaae5a-8730-4f23-8e2e-83e0aeff0df6 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:43:43.218070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaae5a-8730-4f23-8e2e-83e0aeff0df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:43:43.218357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaae5a-8730-4f23-8e2e-83e0aeff0df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:43:43.227394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaae5a-8730-4f23-8e2e-83e0aeff0df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:43:43.228814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaae5a-8730-4f23-8e2e-83e0aeff0df6 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:43:43.238359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 755/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:45:46.752985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:46.753586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:46.753586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:46.771754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:45:46.772959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:45:46.780588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 739/1494] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:45:46.789052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:46.789547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:46.789657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:46.806675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:45:46.807872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:45:46.815386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 756/1495] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:45:46.819701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:46.829404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44122334-ad01-4953-9602-f06cb9c05212 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:46.833780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:46.834412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:46.834688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:46.834962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:46.835710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:45:46.836016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:46.837014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:46.837014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:45:46.837014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:45:46.837876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:46.849504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 740/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:45:46.857402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:46.867477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea53779-b433-4d8a-8425-2c714e421671 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:46.871937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:46.872577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:46.872862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:46.873132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:46.873812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:46.876131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:46.876131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:45:46.876131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:45:46.877333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:46.980526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 757/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:45:46 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:45:46.984453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:46.994306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d2efe-79e2-4fb1-99cc-6509c1c20c13 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:47.048957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:47.049553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.049832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.050103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.050797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:47.051834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:47.051834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:45:47.051834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:45:47.053050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:47.150339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 741/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:45:46 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:45:47.154493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:47.164758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6c25-3c08-49ee-a3b2-55a0a797fdbe admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:47.169194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:47.169841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.170120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.170393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.171113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:47.172160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:47.172160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:45:47.172160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:45:47.173052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:47.186572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 758/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:45:47.191204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:47.201024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890a6c-feec-49ef-afb8-ec689b1d3d9c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:47.206214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:47.206841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.207123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.207400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.208172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:47.209183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:47.209183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:45:47.209183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:45:47.210056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404c421-831c-4469-9d6a-03c3bd4a76fb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:47.223067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 742/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:45:47.227130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:47.237281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a82129-8662-4a29-bbe9-8c4374885abf admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:47.241769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:47.242631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.242907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.243178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] PATH_INFO: `/v3/projects/9a0f8fc0119c4df6b18a408e3b59818d/users/ab2976e3594343918896b91f82f5e235/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.257597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0f8fc0119c4df6b18a408e3b59818d, user_id=ab2976e3594343918896b91f82f5e235, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:47.258615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:47.258615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:45:47.258615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:45:47.260593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:47.357053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 759/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:45:47 2022] PUT /identity/v3/projects/9a0f8fc0119c4df6b18a408e3b59818d/users/ab2976e3594343918896b91f82f5e235/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:45:47.368662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba93ff-f1fd-42bf-9851-c58f477d7061 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.368955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba93ff-f1fd-42bf-9851-c58f477d7061 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.369235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba93ff-f1fd-42bf-9851-c58f477d7061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.394795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-59ba93ff-f1fd-42bf-9851-c58f477d7061 None None] MFA Rules not processed for user `ab2976e3594343918896b91f82f5e235`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:45:47.396056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-59ba93ff-f1fd-42bf-9851-c58f477d7061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:45:47.457834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 743/1502] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:45:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:45:47.468902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:47.543510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d039a75-4935-4b14-ab03-e7b270d7332e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:47.549408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:47.550048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.550326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.550599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.558183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:47.559896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:47.569148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 760/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:45:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:45:47.637869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896938-0b7c-4ac9-9527-b1af5ff9e348 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.638160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896938-0b7c-4ac9-9527-b1af5ff9e348 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.638442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896938-0b7c-4ac9-9527-b1af5ff9e348 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.639754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 744/1504] 10.222.0.23 () {52 vars in 829 bytes} [Tue May 3 22:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:45:47.643819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:47.702055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8d80-a9ea-4c46-a4f5-b72e5a7f27b9 service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:47.707168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:47.708053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:47.708337 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:47.708611 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] PATH_INFO: `/v3/users/ab2976e3594343918896b91f82f5e235` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:47.709775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2976e3594343918896b91f82f5e235)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:47.710784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:47.710784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:45:47.710784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:45:47.712026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:47.918399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2976e3594343918896b91f82f5e235'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:47.979557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2976e3594343918896b91f82f5e235'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:47.992975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2976e3594343918896b91f82f5e235'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:47.998180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2976e3594343918896b91f82f5e235'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:47.998180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2976e3594343918896b91f82f5e235'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:48.017742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 761/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:45:47 2022] DELETE /identity/v3/users/ab2976e3594343918896b91f82f5e235 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:45:48.022118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:48.022581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:48.022762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:48.039704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:45:48.040907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:45:48.097384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 745/1506] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:45:48.106994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:48.108444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:45:48.163963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821b8bf-a938-4d6f-bdc6-3ed657be1957 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:48.167456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a5ce-745f-4850-ad90-883eb52a2559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:48.168119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a5ce-745f-4850-ad90-883eb52a2559 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:48.168397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a5ce-745f-4850-ad90-883eb52a2559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:48.168715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a5ce-745f-4850-ad90-883eb52a2559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:48.177678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a5ce-745f-4850-ad90-883eb52a2559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:48.179096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a5ce-745f-4850-ad90-883eb52a2559 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:48.188637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 762/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:45:48.712881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:45:48.714310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:45:48.726580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3c96-fa6c-4a90-a573-bf3d7dcb76ff None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:45:48.732302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:45:48.733416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:45:48.733703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:45:48.734651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] PATH_INFO: `/v3/projects/9a0f8fc0119c4df6b18a408e3b59818d` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:45:48.735887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0f8fc0119c4df6b18a408e3b59818d)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:45:48.737622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:45:48.737622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:45:48.737622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:45:48.738975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:45:48.829348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0f8fc0119c4df6b18a408e3b59818d', 'request_id': 'req-8da55785-2733-4c76-a278-b92fcf7bce27'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:48.835051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0f8fc0119c4df6b18a408e3b59818d', 'request_id': 'req-8da55785-2733-4c76-a278-b92fcf7bce27'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:48.894297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0f8fc0119c4df6b18a408e3b59818d', 'request_id': 'req-8da55785-2733-4c76-a278-b92fcf7bce27'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:48.913866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] The token cache is being invalidate because project 9a0f8fc0119c4df6b18a408e3b59818d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:45:48.914154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:48.914861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8da55785-2733-4c76-a278-b92fcf7bce27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:45:48.916541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 746/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:45:48 2022] DELETE /identity/v3/projects/9a0f8fc0119c4df6b18a408e3b59818d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:47:30.249770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e0cc-8663-4c5e-bdc6-c047a4922d0b None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:30.250328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e0cc-8663-4c5e-bdc6-c047a4922d0b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:30.250328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907e0cc-8663-4c5e-bdc6-c047a4922d0b None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:30.251711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 763/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:30.256361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edf84-4082-4efd-82dd-de1d6794e2a0 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:30.256765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edf84-4082-4efd-82dd-de1d6794e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:30.256916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4edf84-4082-4efd-82dd-de1d6794e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:30.279412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7e4edf84-4082-4efd-82dd-de1d6794e2a0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:30.280625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7e4edf84-4082-4efd-82dd-de1d6794e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:30.337305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 747/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:30.490027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e0cc-8663-4c5e-bdc6-c047a4922d0b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:30.491803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e907e0cc-8663-4c5e-bdc6-c047a4922d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:30.568390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907e0cc-8663-4c5e-bdc6-c047a4922d0b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:30.574369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3955-47bb-4ecf-8c17-e94ae00a93b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:30.575055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3955-47bb-4ecf-8c17-e94ae00a93b1 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:30.575333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3955-47bb-4ecf-8c17-e94ae00a93b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:30.575651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3955-47bb-4ecf-8c17-e94ae00a93b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:30.583666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3955-47bb-4ecf-8c17-e94ae00a93b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:30.585275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3955-47bb-4ecf-8c17-e94ae00a93b1 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:30.594942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 764/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:31.154603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25a078-24e0-4c60-a6a3-c382e1f27977 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:31.154901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25a078-24e0-4c60-a6a3-c382e1f27977 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:31.155182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25a078-24e0-4c60-a6a3-c382e1f27977 None None] PATH_INFO: `/v3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:31.156652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 748/1512] 10.222.0.36 () {54 vars in 925 bytes} [Tue May 3 22:47:31 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:47:31.162933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10655a-5e27-4f4d-a354-064f619a5bdb None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:31.163276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10655a-5e27-4f4d-a354-064f619a5bdb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:31.163560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10655a-5e27-4f4d-a354-064f619a5bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:31.181294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9f10655a-5e27-4f4d-a354-064f619a5bdb None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:31.182544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9f10655a-5e27-4f4d-a354-064f619a5bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:31.245642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 765/1513] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 22:47:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:31.823379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ca1c-7af9-4095-b957-c46173c854cc None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:31.824063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ca1c-7af9-4095-b957-c46173c854cc None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:31.824063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ca1c-7af9-4095-b957-c46173c854cc None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:31.825358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:31.830034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf386f-78ec-4a00-bf13-e63f731c10c8 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:31.830477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf386f-78ec-4a00-bf13-e63f731c10c8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:31.830613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf386f-78ec-4a00-bf13-e63f731c10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:31.848729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4dbf386f-78ec-4a00-bf13-e63f731c10c8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:31.849957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4dbf386f-78ec-4a00-bf13-e63f731c10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:31.857581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:32.009105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ca1c-7af9-4095-b957-c46173c854cc None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:32.022941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ca1c-7af9-4095-b957-c46173c854cc None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:32.029210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad717-d556-4142-a977-327440f10754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:32.029829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad717-d556-4142-a977-327440f10754 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:32.030107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad717-d556-4142-a977-327440f10754 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:32.030377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad717-d556-4142-a977-327440f10754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:32.038459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aad717-d556-4142-a977-327440f10754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:32.040062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aad717-d556-4142-a977-327440f10754 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:32.049071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 750/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:35.341368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f864-f6b2-43e9-bad1-aeefa7400c2f None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:35.341935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f864-f6b2-43e9-bad1-aeefa7400c2f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:35.341935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f864-f6b2-43e9-bad1-aeefa7400c2f None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:35.343345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 767/1517] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 22:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:47:35.349107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f19617-1167-4002-b1f1-210ff282517b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:35.349556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f19617-1167-4002-b1f1-210ff282517b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:35.349667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f19617-1167-4002-b1f1-210ff282517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:35.368530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-18f19617-1167-4002-b1f1-210ff282517b None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:35.369743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-18f19617-1167-4002-b1f1-210ff282517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:35.378185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 751/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 22:47:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:35.386220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f864-f6b2-43e9-bad1-aeefa7400c2f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:35.399804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f864-f6b2-43e9-bad1-aeefa7400c2f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:35.404666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0708df2-b35d-49a2-b2e4-f905912217ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:35.405285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0708df2-b35d-49a2-b2e4-f905912217ae service placement] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:35.405573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0708df2-b35d-49a2-b2e4-f905912217ae service placement] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:35.405844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0708df2-b35d-49a2-b2e4-f905912217ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:35.414194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0708df2-b35d-49a2-b2e4-f905912217ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:35.415812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0708df2-b35d-49a2-b2e4-f905912217ae service placement] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:35.425272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 768/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:43.688144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b123b-d831-4be4-b2e8-c5ae289f5d25 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:43.688774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b123b-d831-4be4-b2e8-c5ae289f5d25 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:43.688774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b123b-d831-4be4-b2e8-c5ae289f5d25 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:43.690079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 752/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:43.694947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53909-6e04-40a5-a399-7717a3f9aae2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:43.695383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53909-6e04-40a5-a399-7717a3f9aae2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:43.695483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53909-6e04-40a5-a399-7717a3f9aae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:43.714178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-02f53909-6e04-40a5-a399-7717a3f9aae2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:43.715362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-02f53909-6e04-40a5-a399-7717a3f9aae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:43.723012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 769/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:43.871408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b123b-d831-4be4-b2e8-c5ae289f5d25 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:43.885957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b123b-d831-4be4-b2e8-c5ae289f5d25 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:43.891231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e47f7-fc2c-4e1c-b5c6-369f9af502d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:43.891903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47f7-fc2c-4e1c-b5c6-369f9af502d7 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:43.892192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47f7-fc2c-4e1c-b5c6-369f9af502d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:43.892468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e47f7-fc2c-4e1c-b5c6-369f9af502d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:43.900370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e47f7-fc2c-4e1c-b5c6-369f9af502d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:43.902499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e47f7-fc2c-4e1c-b5c6-369f9af502d7 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:43.911976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 753/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:45.112683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375800-3d5f-48df-b715-6600e50137ee None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:45.113249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375800-3d5f-48df-b715-6600e50137ee None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:45.113249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e375800-3d5f-48df-b715-6600e50137ee None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:45.114591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 770/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 3 22:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:45.119217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f361-2d5a-4d3e-b389-5fafac64fac9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:45.119658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f361-2d5a-4d3e-b389-5fafac64fac9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:45.119838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f361-2d5a-4d3e-b389-5fafac64fac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:45.137614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d3a5f361-2d5a-4d3e-b389-5fafac64fac9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:45.138796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d3a5f361-2d5a-4d3e-b389-5fafac64fac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:45.146448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 754/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 3 22:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:45.294648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e375800-3d5f-48df-b715-6600e50137ee None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:45.309069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e375800-3d5f-48df-b715-6600e50137ee None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:45.314403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4006d3c-a49b-4a6c-9b15-1634202cbf03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:45.315029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006d3c-a49b-4a6c-9b15-1634202cbf03 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:45.315313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006d3c-a49b-4a6c-9b15-1634202cbf03 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:45.315590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4006d3c-a49b-4a6c-9b15-1634202cbf03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:45.324009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006d3c-a49b-4a6c-9b15-1634202cbf03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:45.325592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4006d3c-a49b-4a6c-9b15-1634202cbf03 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:45.334752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 771/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:49.515212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e6b0-fe82-43b8-a8cc-82bdd743c7f6 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:49.515776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e6b0-fe82-43b8-a8cc-82bdd743c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:49.515776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e6b0-fe82-43b8-a8cc-82bdd743c7f6 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:49.517140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 755/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:49.522206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4de7-95a5-44f2-aef6-978e55037afb None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:49.522614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4de7-95a5-44f2-aef6-978e55037afb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:49.522762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4de7-95a5-44f2-aef6-978e55037afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:49.546070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-face4de7-95a5-44f2-aef6-978e55037afb None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:49.547596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-face4de7-95a5-44f2-aef6-978e55037afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:49.555392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 772/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:49.591278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e6b0-fe82-43b8-a8cc-82bdd743c7f6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:49.592945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e1c0e6b0-fe82-43b8-a8cc-82bdd743c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:49.649245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e6b0-fe82-43b8-a8cc-82bdd743c7f6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:49.653237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869829-410b-4fac-9c0a-712a4bea47be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:49.653871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869829-410b-4fac-9c0a-712a4bea47be service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:49.654150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869829-410b-4fac-9c0a-712a4bea47be service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:49.654422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869829-410b-4fac-9c0a-712a4bea47be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:49.663300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869829-410b-4fac-9c0a-712a4bea47be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:49.664761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d869829-410b-4fac-9c0a-712a4bea47be service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:49.673758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 756/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:51.896178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d46e0f-ccc6-40c8-b130-0b090d3002d6 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:51.896755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d46e0f-ccc6-40c8-b130-0b090d3002d6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:51.896755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d46e0f-ccc6-40c8-b130-0b090d3002d6 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:51.898152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 773/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:51.903338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b7b0f-ab2f-42ce-80cb-8d7a3346c87b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:51.903818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b7b0f-ab2f-42ce-80cb-8d7a3346c87b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:51.903915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b7b0f-ab2f-42ce-80cb-8d7a3346c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:51.922080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f25b7b0f-ab2f-42ce-80cb-8d7a3346c87b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:51.923246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f25b7b0f-ab2f-42ce-80cb-8d7a3346c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:51.930901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 757/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:51.965738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d46e0f-ccc6-40c8-b130-0b090d3002d6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:51.976218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d46e0f-ccc6-40c8-b130-0b090d3002d6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:51.980484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2d78f-8819-4850-9cf1-693361234a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:51.981105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d78f-8819-4850-9cf1-693361234a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:51.981382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d78f-8819-4850-9cf1-693361234a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:51.981654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2d78f-8819-4850-9cf1-693361234a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:51.991102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d78f-8819-4850-9cf1-693361234a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:51.992571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2d78f-8819-4850-9cf1-693361234a21 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:52.004130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 774/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:55.740660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366580fd-69ff-4572-bebd-6b1f4981665d None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:55.741193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366580fd-69ff-4572-bebd-6b1f4981665d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:55.741193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366580fd-69ff-4572-bebd-6b1f4981665d None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:55.742516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 758/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:55.747748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176179da-9781-466b-afe3-1e93f744fed2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:55.748199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176179da-9781-466b-afe3-1e93f744fed2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:55.748335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176179da-9781-466b-afe3-1e93f744fed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:55.766226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-176179da-9781-466b-afe3-1e93f744fed2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:55.767427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-176179da-9781-466b-afe3-1e93f744fed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:55.774957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 775/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:56.047328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366580fd-69ff-4572-bebd-6b1f4981665d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:56.049093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-366580fd-69ff-4572-bebd-6b1f4981665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:56.104119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366580fd-69ff-4572-bebd-6b1f4981665d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:56.107581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c107-1f3f-4adc-b55c-7492552bee02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:56.108282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c107-1f3f-4adc-b55c-7492552bee02 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:56.108563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c107-1f3f-4adc-b55c-7492552bee02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:56.108838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c107-1f3f-4adc-b55c-7492552bee02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:56.117450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c107-1f3f-4adc-b55c-7492552bee02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:56.118938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c107-1f3f-4adc-b55c-7492552bee02 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:56.131554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 759/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:47:58.427533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8948-dc41-452e-b9a9-715409225cf4 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:58.428144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8948-dc41-452e-b9a9-715409225cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:58.428144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a8948-dc41-452e-b9a9-715409225cf4 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:58.429415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 776/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 3 22:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:58.434631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3284-dc31-41a6-b989-23b0db2bbb35 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:58.435052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3284-dc31-41a6-b989-23b0db2bbb35 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:58.435187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da3284-dc31-41a6-b989-23b0db2bbb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:58.452663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-21da3284-dc31-41a6-b989-23b0db2bbb35 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:58.453841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-21da3284-dc31-41a6-b989-23b0db2bbb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:58.461379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 760/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 3 22:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:58.727790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aae41-8497-4089-8ec3-bdd87a50fa0f None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:58.728081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aae41-8497-4089-8ec3-bdd87a50fa0f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:58.728360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aae41-8497-4089-8ec3-bdd87a50fa0f None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:58.729724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 777/1537] 10.222.0.23 () {54 vars in 963 bytes} [Tue May 3 22:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:47:58.734614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8b85e-4ca9-4962-8a22-68712c58c914 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:58.734908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8b85e-4ca9-4962-8a22-68712c58c914 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:58.735186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8b85e-4ca9-4962-8a22-68712c58c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:58.754375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-39e8b85e-4ca9-4962-8a22-68712c58c914 None None] MFA Rules not processed for user `5ec2e18cb1804b6f94d646491f8c20c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:47:58.755562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-39e8b85e-4ca9-4962-8a22-68712c58c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:47:58.762481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 761/1538] 10.222.0.23 () {58 vars in 1060 bytes} [Tue May 3 22:47:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:47:58.769902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aae41-8497-4089-8ec3-bdd87a50fa0f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:47:58.780990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aae41-8497-4089-8ec3-bdd87a50fa0f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:47:58.784719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f708336-729e-4a59-b746-ddc39e2fc24f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:47:58.785331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708336-729e-4a59-b746-ddc39e2fc24f service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:47:58.785606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708336-729e-4a59-b746-ddc39e2fc24f service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:47:58.785876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f708336-729e-4a59-b746-ddc39e2fc24f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:47:58.794394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708336-729e-4a59-b746-ddc39e2fc24f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:47:58.795828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f708336-729e-4a59-b746-ddc39e2fc24f service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:47:58.804899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 778/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:29.517534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614630-7126-4760-a682-7b58590cae98 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.534934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614630-7126-4760-a682-7b58590cae98 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.534934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40614630-7126-4760-a682-7b58590cae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.544878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b36e3-14ca-4f35-9c85-b1816e981fe2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.545898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b36e3-14ca-4f35-9c85-b1816e981fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.546392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b36e3-14ca-4f35-9c85-b1816e981fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.555008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-40614630-7126-4760-a682-7b58590cae98 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:29.556260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-40614630-7126-4760-a682-7b58590cae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:29.573347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-895b36e3-14ca-4f35-9c85-b1816e981fe2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:29.573727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 762/1540] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:29.574736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-895b36e3-14ca-4f35-9c85-b1816e981fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:29.583690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.584627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.585071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.591839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 779/1541] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:29.599976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.600261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.600846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.614068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:29.615912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:29.628528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 763/1542] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:29.634554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:29.642343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:29.643563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:29.646187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048d2b-630d-4a1b-be9a-a81db700b586 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:29.656013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:29.657110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.658131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.658604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.659799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:29.660317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:29.668111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 780/1543] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:29.669828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:29.672637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:29.689089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 764/1544] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:49:29.690213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f1808-a764-487b-b0d5-03f18f542de5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:29.701600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:29.702451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:29.707642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.707642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.707642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.707642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:29.707642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:29.708071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 03 22:49:29.708071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:49:29.708071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:49:29.708071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:29.717991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fbfaa8-7cb0-45ec-8e2b-b509a1ae2559 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:29.723820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:29.725281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.725745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.726192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.727045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:29.728252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:49:29.728252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:49:29.728252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:49:29.733763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2fa5d-679c-45a2-8221-7678f8b80d08 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:29.734217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 781/1545] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:29.747555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:29.766119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc448768-8fd8-4cdb-a443-dfc849b7efa4 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:29.779637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:29.780355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.780633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.780909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.781632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:29.784221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:29.904610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 765/1546] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:29.906587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361674-535b-4874-ae4d-0bed345194e5 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:29.907182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361674-535b-4874-ae4d-0bed345194e5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:29.908612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60361674-535b-4874-ae4d-0bed345194e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:29.932880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-60361674-535b-4874-ae4d-0bed345194e5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:29.934240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-60361674-535b-4874-ae4d-0bed345194e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:29.950505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 782/1547] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:29.951338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.057856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 766/1548] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.058918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.059212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.059492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.072663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65915dc-94ab-4e3a-b446-c11e3308dc6e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.077338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.078176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.078468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.079043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.079735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.080782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:49:30.080782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:49:30.080782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:49:30.082012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c7892-6c43-48ab-9b6f-b376a96cd463 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.082132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.083353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.091215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 767/1549] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.092022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.101871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cc0c1-7ca8-43e0-bdf0-ac84f251f8ac None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.106364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3183acc-2b4f-4bfc-bc1b-00263b2f5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.107047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3183acc-2b4f-4bfc-bc1b-00263b2f5c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.107327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3183acc-2b4f-4bfc-bc1b-00263b2f5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.107630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3183acc-2b4f-4bfc-bc1b-00263b2f5c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.108313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3183acc-2b4f-4bfc-bc1b-00263b2f5c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.110498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3183acc-2b4f-4bfc-bc1b-00263b2f5c0f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.228266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 783/1550] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:29 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:30.229673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ae234-6a63-40bc-b22b-d57adccf7c47 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.229970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ae234-6a63-40bc-b22b-d57adccf7c47 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.230250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ae234-6a63-40bc-b22b-d57adccf7c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.244187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 768/1551] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:30.244187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d943-bb8c-4691-9bd9-fdb9f97aadfa None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.244187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d943-bb8c-4691-9bd9-fdb9f97aadfa None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.244187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75d943-bb8c-4691-9bd9-fdb9f97aadfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.248967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-714ae234-6a63-40bc-b22b-d57adccf7c47 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.253618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-714ae234-6a63-40bc-b22b-d57adccf7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.258613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 784/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.260005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f340-c156-4be3-b9cb-3664c172005e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.260220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f340-c156-4be3-b9cb-3664c172005e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.260588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f340-c156-4be3-b9cb-3664c172005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.260965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5c75d943-bb8c-4691-9bd9-fdb9f97aadfa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.262140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5c75d943-bb8c-4691-9bd9-fdb9f97aadfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.278314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 769/1553] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.278314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe840b-7dab-4000-959d-71dc99384d99 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.278314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe840b-7dab-4000-959d-71dc99384d99 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.278314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe840b-7dab-4000-959d-71dc99384d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.283067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ea96f340-c156-4be3-b9cb-3664c172005e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.283067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ea96f340-c156-4be3-b9cb-3664c172005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.289200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 785/1554] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.291116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.291684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.291913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.296005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-1fbe840b-7dab-4000-959d-71dc99384d99 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.297411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1fbe840b-7dab-4000-959d-71dc99384d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.306249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 770/1555] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.311507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.311507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.311507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.311806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.312345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.321101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 786/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.321741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.328936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.330080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.330897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3e555-1276-48c6-8f0f-a002b6f405c4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.335317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d34e66-725d-472a-9a5c-303af245be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.335997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d34e66-725d-472a-9a5c-303af245be62 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.336282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d34e66-725d-472a-9a5c-303af245be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.336573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d34e66-725d-472a-9a5c-303af245be62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.337269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d34e66-725d-472a-9a5c-303af245be62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.338205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 771/1557] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.338979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.339093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d34e66-725d-472a-9a5c-303af245be62 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.352536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 787/1558] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:30.352536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeec73b-e0ff-4a7d-adda-7fbffc4a711d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.352536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeec73b-e0ff-4a7d-adda-7fbffc4a711d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.352536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeec73b-e0ff-4a7d-adda-7fbffc4a711d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.353011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a7a7-1a9a-49e2-a076-ab1d5cab2ef3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.357235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1266d13-358d-425a-9c79-dd54854a44a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.357891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1266d13-358d-425a-9c79-dd54854a44a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.358176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1266d13-358d-425a-9c79-dd54854a44a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.358449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1266d13-358d-425a-9c79-dd54854a44a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.359177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1266d13-358d-425a-9c79-dd54854a44a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.361406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1266d13-358d-425a-9c79-dd54854a44a5 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.370983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-daeec73b-e0ff-4a7d-adda-7fbffc4a711d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.382475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 772/1559] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:30.382624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-daeec73b-e0ff-4a7d-adda-7fbffc4a711d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.382719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.382719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.382719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.382949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 788/1560] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.382949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.382949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.382949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.390831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.392059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.399966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 773/1561] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.400509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.400800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.401670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.410828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 789/1562] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.415087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28159-5f14-4bff-bb01-d258d6f302b8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.415222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.416205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.416846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.417449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.417733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.418457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:30.418760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.420385 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39455063-a41a-4683-8fb7-84ac2ebd07be admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.421969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f471-8f95-41ad-a3e0-ba319a843421 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.427028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.427752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.428036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.428308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.429031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:30.429335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.430933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.432633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 774/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:30.433997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.434284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.434559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.443131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 790/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:30.443917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.453323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e2e18-4e77-4535-8f58-f74ac327f8c5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.455175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:30.455175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:30.457943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.458651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.458869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.459146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.459904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.461516 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.463009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 775/1565] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:30.463930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.473545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 791/1566] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:30.474490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.474654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dee0f1-6c5a-4adc-9d90-dc66598f2c94 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.480546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.481457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.484003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.484003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.484003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.484479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.487052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fd76d-9e9e-4bb1-b11c-e27a92a9b62e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.491556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.492218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.492495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.492764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.493475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:30.493776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.495029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 776/1567] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:30.496065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.496199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.505596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079049f-c6cc-4f32-88a9-91623b2e1558 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.508423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 792/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:30.509340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.517269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.521031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.521031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.521031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.521770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d575a-ea16-4f70-9658-fbc3f58cacb3 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.521878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:30.521878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.521878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.523706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.524444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.524800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.525148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.525971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:30.526380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.528058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.535646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 777/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:30.536525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.545685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 793/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:30.555595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54480b-9ce6-4f6a-b4df-eda785f426e6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.555755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.555841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.555841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.555841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.555841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.556160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.556160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.558853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633d4d-7b2c-4166-a269-84b8987e1810 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.566119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.566761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.567034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.567304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.568023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.569986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.744318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 794/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:30.744527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 778/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:30.745378 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.745649 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.806674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a04934-62c6-410c-85b3-b1dca1487f1e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.807625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856c3136-3167-4d16-b407-84202970d529 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.811681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.812348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.812583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.815739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.815739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.815957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.816046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:30.816142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.816142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] PATH_INFO: `/v3/projects/28d46cd5be5e43a383421d5d240aae66/users/c4fe84a5f106475eba45452e6a3f52c9/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.816326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.816422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.827996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 779/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:30.828792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.829955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d46cd5be5e43a383421d5d240aae66, user_id=c4fe84a5f106475eba45452e6a3f52c9, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.832786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.838492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49420-6b54-43bc-8e4c-4e5cc60450c1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:30.843049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:30.843987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:30.844269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:30.844543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] PATH_INFO: `/v3/projects/e2c0dee5894b4f6e8878469afd6b46fc/users/f2d887cbc0874694934cb28a884bb4c5/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:30.858615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c0dee5894b4f6e8878469afd6b46fc, user_id=f2d887cbc0874694934cb28a884bb4c5, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:30.859670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:49:30.859670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:49:30.859670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:49:30.862117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:30.937138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 795/1574] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:30 2022] PUT /identity/v3/projects/28d46cd5be5e43a383421d5d240aae66/users/c4fe84a5f106475eba45452e6a3f52c9/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:30.938120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:30.958990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 780/1575] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:30 2022] PUT /identity/v3/projects/e2c0dee5894b4f6e8878469afd6b46fc/users/f2d887cbc0874694934cb28a884bb4c5/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:30.960228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.005439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d03f3-79e8-4cb5-8af3-0457bcab7186 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.024292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee74a-5038-471b-a219-66549636c967 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.029005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.031137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.031137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.031137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.031137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.033303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.083150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.083840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.084125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.084400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.085087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.087002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.172394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 781/1576] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.173911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.204498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 796/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:30 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.204498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.234555 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166723a6-18ac-4fdf-a3d8-c7420c3bf30b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.262324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e008-1a19-4ac7-b50f-cc85b2064522 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.266862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.267537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.267856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.268138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.268828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.270763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.288530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.292801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.292801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.292801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.292801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.292801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.384994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 797/1578] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.384994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.394036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a9b09-e2e6-4e86-8555-80d9dbc8ffdc admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.398509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884dfe-4deb-48af-9dfa-bdcd17aace93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.399200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884dfe-4deb-48af-9dfa-bdcd17aace93 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.399483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884dfe-4deb-48af-9dfa-bdcd17aace93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.399793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884dfe-4deb-48af-9dfa-bdcd17aace93 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.400461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884dfe-4deb-48af-9dfa-bdcd17aace93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.402359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884dfe-4deb-48af-9dfa-bdcd17aace93 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.414121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 782/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.414121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.471696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51ed59-fab2-4ed2-9b87-a254b137f4be admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.476173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.476817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.477099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.477373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.478055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.479984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.509309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 798/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.510588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61d48-ec6b-459a-a1af-766fcc412acf None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.510875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61d48-ec6b-459a-a1af-766fcc412acf None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.511159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b61d48-ec6b-459a-a1af-766fcc412acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.536134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-43b61d48-ec6b-459a-a1af-766fcc412acf None None] MFA Rules not processed for user `c4fe84a5f106475eba45452e6a3f52c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:31.537259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-43b61d48-ec6b-459a-a1af-766fcc412acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:31.600053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 799/1581] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:31.601524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.601911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.602359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.607682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 783/1582] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.608513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.621183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:31.623976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:31.670064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5400c-8b7d-44c6-9f6a-f21169990177 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.674759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.675434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.675726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.676011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.676703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.678621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.681256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 800/1583] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:31.682147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.691795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fe8e2-a285-4278-9197-8dcc15322d2a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.696479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.697139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.704922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.704922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.704922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.704922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.804933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 784/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.805787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.815710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e93fc9-4c1d-487a-8b95-2839320c9eb6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.820542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 801/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/users => generated 283 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.820542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.821332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.822056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.822406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.822746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.823539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.825239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.831160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300211b7-7fdd-416f-883b-e7258dd9b02e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.835917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 785/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:31.836048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.836778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.836892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.837237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.837807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.838588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.840708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.846243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b37bafa-620c-4f5f-8281-0c501340601b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.850776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.851400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.851704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.851977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.852680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.854272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.864625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 786/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:31.865552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.874555 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7230-734b-436f-a55f-afebfa20882c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.879579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.880207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.880490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.880768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.881439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.883272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:31.930349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 802/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:31.931261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:31.941083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59ac69-84cb-436c-858e-be31ba19436b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:31.945639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:31.946304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:31.946580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:31.946848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:31.947506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:31.949426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.012229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 787/1589] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:32.013891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.052068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 803/1590] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:31 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:32.053154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.064396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fcb50-d6c9-485f-84f3-f7ed872c7edd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.073161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2db54c-8e24-4564-aff8-257d8ff2dd0a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.077932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.078722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.079011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.079948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.124459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.125123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.125401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.125672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.126973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.128591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.137941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 804/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.138792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.139337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.140995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.149151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e755d9b-d7fa-42df-8cc9-1a074fc31fcf admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.150596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 788/1592] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:32.151393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.153889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.154873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.155211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.155494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.156352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.157865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.160634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9676f6a-d112-47fc-a775-207a2cd39f25 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.165551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.166205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.166489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.166766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.167491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.169123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.169564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 805/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.170427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.186362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b630d2c-0393-4991-89a4-8a2bcf034e7c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.186469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 789/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.186469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.188744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.190051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.190333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.190604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.191374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.193012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.194991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc880655-a150-42ec-9359-cb28a53ff303 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.199638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.200307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.200593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.200872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.201598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.203211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.203780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 806/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.204607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.213800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edd641-bac6-4724-9ef4-762891529e50 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.215666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 790/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.216485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.218708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.219393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.219711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.220013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.220725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.231878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.232019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c170fef-e76e-408e-8cb8-8dd8630134f4 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.232019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.232019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.232019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.232352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.232352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.233858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.244572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 791/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.245354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.254947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b2c5-676c-4aa6-a1e5-9cff7f6c8367 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.259561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.260234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.265947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.265947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.265947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.265947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.272723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 792/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.273524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.282756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf5d9c-e832-4c3b-8d6a-396ea85eb622 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.288106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.288761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.289103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.289386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.290119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.291932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.306068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 793/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.306946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.324587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 807/1600] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:32 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:32.324587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.331301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273117b-c133-488e-b903-3f278775c4e6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.336167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d35d1-8a1b-4fd8-81d8-43e34524042c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.340940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.341948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.342298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.342627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] PATH_INFO: `/v3/projects/54e7471a56604859b29e095bcd358a8b/users/7087797701f542b0b872f99450756910/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.345675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.348588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.349193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.349685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] PATH_INFO: `/v3/projects/cd0e2add97d14fe98880b55132c9f16f/users/dd0ac9313e0149bbaabbcbeaa35b1d01/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.359552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e7471a56604859b29e095bcd358a8b, user_id=7087797701f542b0b872f99450756910, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.363512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.367903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0e2add97d14fe98880b55132c9f16f, user_id=dd0ac9313e0149bbaabbcbeaa35b1d01, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.370700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.497503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 794/1601] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:32 2022] PUT /identity/v3/projects/cd0e2add97d14fe98880b55132c9f16f/users/dd0ac9313e0149bbaabbcbeaa35b1d01/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:32.497836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 808/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:32 2022] PUT /identity/v3/projects/54e7471a56604859b29e095bcd358a8b/users/7087797701f542b0b872f99450756910/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:32.498845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.498988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.569777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5581a7-cf26-424a-9fe2-a70dd9bb922e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.573553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571e73b-4242-41da-9265-f452f0ede8ce admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.575061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.575809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.576198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.576582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.577348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.578184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.578881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.579005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.579162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.579465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.580226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.581857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.589796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 795/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.595958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.596077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 809/1604] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.596077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.600454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078bc4a-502d-476d-8d5c-9d13427a0dcc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.605227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.605918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958d4db-ec55-4020-bdbd-bfb9e4a04973 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.606361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.606565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.606885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] PATH_INFO: `/v3/projects/a9a41f409d8c477fa7d0d7c9a49fda4a/users/3d5b568d681e489798c4ef805601ef6b/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.610561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac255-7720-499b-ae34-f2eb3f4f1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.611974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac255-7720-499b-ae34-f2eb3f4f1029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.612257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac255-7720-499b-ae34-f2eb3f4f1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.612533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac255-7720-499b-ae34-f2eb3f4f1029 admin admin] PATH_INFO: `/v3/projects/ce3c6882ccea47e8a23470dce6dfa70d/users/b7888d29b1f3444abb8fd9b39f2044d8/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.622365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a41f409d8c477fa7d0d7c9a49fda4a, user_id=3d5b568d681e489798c4ef805601ef6b, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.625081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.626804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ac255-7720-499b-ae34-f2eb3f4f1029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3c6882ccea47e8a23470dce6dfa70d, user_id=b7888d29b1f3444abb8fd9b39f2044d8, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.629460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ac255-7720-499b-ae34-f2eb3f4f1029 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.726919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 796/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:32 2022] PUT /identity/v3/projects/a9a41f409d8c477fa7d0d7c9a49fda4a/users/3d5b568d681e489798c4ef805601ef6b/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:32.729653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.789043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9434145-b3cd-4422-9835-d09a817f7869 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.810025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 810/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:32 2022] PUT /identity/v3/projects/ce3c6882ccea47e8a23470dce6dfa70d/users/b7888d29b1f3444abb8fd9b39f2044d8/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:32.810025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.810025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.810025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.815655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:32.817316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:32.847836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e83ce4-831e-461b-ae9a-057ce5409b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.848650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e83ce4-831e-461b-ae9a-057ce5409b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.848935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e83ce4-831e-461b-ae9a-057ce5409b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.849211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e83ce4-831e-461b-ae9a-057ce5409b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.849944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e83ce4-831e-461b-ae9a-057ce5409b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.851566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e83ce4-831e-461b-ae9a-057ce5409b7f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.861898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 797/1607] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:32.866580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.866580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.866580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.877333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 811/1608] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:32.878220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.887893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb2a23-07da-44b1-b87a-c243568ce9ca None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.889140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] MFA Rules not processed for user `7087797701f542b0b872f99450756910`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:32.890339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:32.893008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e079b5-7382-41f9-abd2-8c2f9afd0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.893891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e079b5-7382-41f9-abd2-8c2f9afd0a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.894178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e079b5-7382-41f9-abd2-8c2f9afd0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.894445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e079b5-7382-41f9-abd2-8c2f9afd0a2d admin admin] PATH_INFO: `/v3/projects/76dfa0aca06245aea5d79f4a92e36e17/users/d7353d5eef814367844ffbb574c6a45e/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.913561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e079b5-7382-41f9-abd2-8c2f9afd0a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dfa0aca06245aea5d79f4a92e36e17, user_id=d7353d5eef814367844ffbb574c6a45e, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.916417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e079b5-7382-41f9-abd2-8c2f9afd0a2d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:32.954124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 798/1609] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:32.955911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:32.968768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef220d-a62a-48d7-abeb-39096feb4343 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:32.977263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:32.978166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:32.978451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:32.978724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] PATH_INFO: `/v3/projects/6a1de14c94b24239a57669664273a33e/users/28b935fbbbb143cd94c9b54cec888607/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:32.995898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1de14c94b24239a57669664273a33e, user_id=28b935fbbbb143cd94c9b54cec888607, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:32.997098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 812/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:32 2022] PUT /identity/v3/projects/76dfa0aca06245aea5d79f4a92e36e17/users/d7353d5eef814367844ffbb574c6a45e/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:33.000793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1b76-365f-4dc7-97b4-b503832d4266 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.005780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.005931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1b76-365f-4dc7-97b4-b503832d4266 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.005931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed1b76-365f-4dc7-97b4-b503832d4266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.026859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8fed1b76-365f-4dc7-97b4-b503832d4266 None None] MFA Rules not processed for user `3d5b568d681e489798c4ef805601ef6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.028085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8fed1b76-365f-4dc7-97b4-b503832d4266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.090799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 813/1611] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:33.091650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 799/1612] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:32 2022] PUT /identity/v3/projects/6a1de14c94b24239a57669664273a33e/users/28b935fbbbb143cd94c9b54cec888607/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:33.096095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.096361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.096484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.096484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.124795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] MFA Rules not processed for user `b7888d29b1f3444abb8fd9b39f2044d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.125902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.159973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28312a8-0b19-416f-85df-c6830f9e3454 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.165238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79875-65bc-4bc7-97c3-371082f97b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.166159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79875-65bc-4bc7-97c3-371082f97b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.166440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79875-65bc-4bc7-97c3-371082f97b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.166716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79875-65bc-4bc7-97c3-371082f97b18 admin admin] PATH_INFO: `/v3/projects/7828be0741be4d34a1be2cf0fa5ffac3/users/d1365aac543d46d89060017976283b56/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.181583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79875-65bc-4bc7-97c3-371082f97b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7828be0741be4d34a1be2cf0fa5ffac3, user_id=d1365aac543d46d89060017976283b56, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.184278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b79875-65bc-4bc7-97c3-371082f97b18 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.192541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 814/1613] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:33.193583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.197135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.252289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 800/1614] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:33 2022] PUT /identity/v3/projects/7828be0741be4d34a1be2cf0fa5ffac3/users/d1365aac543d46d89060017976283b56/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:33.254151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3251d3-134b-4967-abb9-be770421dad2 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.254581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3251d3-134b-4967-abb9-be770421dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.255090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3251d3-134b-4967-abb9-be770421dad2 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.256653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e72f1-5aee-4bc3-a573-3326a6c1422d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.256815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 801/1615] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 22:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:49:33.257939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3e48-e084-464e-b10a-54296ec5281c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.258282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3e48-e084-464e-b10a-54296ec5281c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.258561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e3e48-e084-464e-b10a-54296ec5281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.277030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a91e3e48-e084-464e-b10a-54296ec5281c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.278227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a91e3e48-e084-464e-b10a-54296ec5281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.306090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.306740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.307028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.307305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.336404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 802/1616] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:33.337760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f485d4-3a9b-4321-bc6c-0e9f55668c13 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.337983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f485d4-3a9b-4321-bc6c-0e9f55668c13 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.338274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f485d4-3a9b-4321-bc6c-0e9f55668c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.356929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-19f485d4-3a9b-4321-bc6c-0e9f55668c13 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.358248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-19f485d4-3a9b-4321-bc6c-0e9f55668c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.366306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 803/1617] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:33.367431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.367632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b141-fd1c-409a-b74e-6465ecd282e2 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.367925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b141-fd1c-409a-b74e-6465ecd282e2 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.368202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3b141-fd1c-409a-b74e-6465ecd282e2 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.368959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.369688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 804/1618] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 22:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:49:33.370157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b141-fd1c-409a-b74e-6465ecd282e2 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.379459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 815/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:33.380108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.384499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3b141-fd1c-409a-b74e-6465ecd282e2 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.389175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f1832-9d44-4b53-aceb-f90214928cd6 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.389313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6a3e9-19df-49b6-a165-9d654c9276cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.389929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a3e9-19df-49b6-a165-9d654c9276cd admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.390233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a3e9-19df-49b6-a165-9d654c9276cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.390489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6a3e9-19df-49b6-a165-9d654c9276cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.391182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6a3e9-19df-49b6-a165-9d654c9276cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.393736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6a3e9-19df-49b6-a165-9d654c9276cd admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.395832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fcbc-2344-4e65-84e7-6a79342e9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.396687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fcbc-2344-4e65-84e7-6a79342e9c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.396978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fcbc-2344-4e65-84e7-6a79342e9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.397253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fcbc-2344-4e65-84e7-6a79342e9c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.397990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2fcbc-2344-4e65-84e7-6a79342e9c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.399591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2fcbc-2344-4e65-84e7-6a79342e9c87 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.410201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 816/1620] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:33.411450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.411827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.412111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.429559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.430748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.495656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 817/1621] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:33.496529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.516027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 805/1622] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:33.516027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.516027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.516027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.519392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a72b8f-d87f-4348-9b36-296c2768d1e3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.543688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.544964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.597786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.599281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.599675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.600030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.637413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 806/1623] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:33.639077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.648132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796be6f-0bb2-4247-8b07-b8d71aa8eb54 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.651815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.652993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.652993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.653232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.665105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.667285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.679939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 818/1624] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:33.680929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.692039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce507601-3573-4b26-9b67-97807a0f9de5 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.699097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.700072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.700356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.700694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] PATH_INFO: `/v3/projects/7828be0741be4d34a1be2cf0fa5ffac3/users/d1365aac543d46d89060017976283b56/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.702797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7828be0741be4d34a1be2cf0fa5ffac3, user_id=d1365aac543d46d89060017976283b56, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.705556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.718398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.718524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 819/1625] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:33 2022] PUT /identity/v3/projects/7828be0741be4d34a1be2cf0fa5ffac3/users/d1365aac543d46d89060017976283b56/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:33.718618 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.718714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.733542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 807/1626] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:33.734741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.746827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06b9e-0baf-48f9-a2a7-599698fb3450 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.806269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cccde-74d1-43c1-8b99-ae884309acc9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.810662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.811514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.812020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.812126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda3810-ba5e-4c69-b9a6-0fb25d4adcf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.812513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.812732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda3810-ba5e-4c69-b9a6-0fb25d4adcf3 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.813016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda3810-ba5e-4c69-b9a6-0fb25d4adcf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.813290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda3810-ba5e-4c69-b9a6-0fb25d4adcf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.813675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.816327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.872346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda3810-ba5e-4c69-b9a6-0fb25d4adcf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:33.874138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda3810-ba5e-4c69-b9a6-0fb25d4adcf3 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:33.884779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 820/1627] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:33.886228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e795e1b-6be2-45aa-8e55-a4492ffd5ad4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.886639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e795e1b-6be2-45aa-8e55-a4492ffd5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.887111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e795e1b-6be2-45aa-8e55-a4492ffd5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:33.902073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 808/1628] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:33.902073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:33.924793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90a793-c6d0-49da-9bc6-aa04a364cbce admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:33.935209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3e795e1b-6be2-45aa-8e55-a4492ffd5ad4 None None] MFA Rules not processed for user `f2d887cbc0874694934cb28a884bb4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:33.937161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3e795e1b-6be2-45aa-8e55-a4492ffd5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:33.939642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:33.940575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:33.940937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:33.942672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.051743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 821/1629] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:34.053786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.054272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.055017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.099579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.101398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.113809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] MFA Rules not processed for user `d1365aac543d46d89060017976283b56`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:34.118226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:34.120636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 809/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:34.121795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.135013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9ae50-87c1-4fc6-a8f3-c3ec2fc38b80 service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.140226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bb763-9598-4a39-b88b-5b83b8346fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.141050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb763-9598-4a39-b88b-5b83b8346fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.141634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb763-9598-4a39-b88b-5b83b8346fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.142418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bb763-9598-4a39-b88b-5b83b8346fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.143250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bb763-9598-4a39-b88b-5b83b8346fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.145098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4bb763-9598-4a39-b88b-5b83b8346fcf admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.156660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 810/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:34.156660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.156660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.156660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.181881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] MFA Rules not processed for user `f2d887cbc0874694934cb28a884bb4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:34.183220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:34.192256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 811/1632] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:34.193391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.228753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f711b-f5cf-4801-b164-f348cb53c13d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.245757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393767b-b4a4-4d7d-a3d3-a83c825fdd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.245757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393767b-b4a4-4d7d-a3d3-a83c825fdd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.245757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393767b-b4a4-4d7d-a3d3-a83c825fdd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.245757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393767b-b4a4-4d7d-a3d3-a83c825fdd38 admin admin] PATH_INFO: `/v3/projects/32b0b20d396e4439aaa42f4e2434a8e7/users/04f87438c6f740d591faf0371dd3a6ef/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.268463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 822/1633] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:34.270518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.275342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393767b-b4a4-4d7d-a3d3-a83c825fdd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0b20d396e4439aaa42f4e2434a8e7, user_id=04f87438c6f740d591faf0371dd3a6ef, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.278009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393767b-b4a4-4d7d-a3d3-a83c825fdd38 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.355141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c7ad-4a6f-4013-8fe6-e4ea36d90195 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.359424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14dc2dd-ebfd-4106-976a-f9b930ac0937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.360111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dc2dd-ebfd-4106-976a-f9b930ac0937 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.361723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dc2dd-ebfd-4106-976a-f9b930ac0937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.362049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14dc2dd-ebfd-4106-976a-f9b930ac0937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.374210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 812/1634] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:34 2022] PUT /identity/v3/projects/32b0b20d396e4439aaa42f4e2434a8e7/users/04f87438c6f740d591faf0371dd3a6ef/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:34.374210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60cfae-0302-4e0c-a1e0-694c93e078b6 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.374210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60cfae-0302-4e0c-a1e0-694c93e078b6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.374210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60cfae-0302-4e0c-a1e0-694c93e078b6 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.376212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 813/1635] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 22:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:49:34.377303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60cfae-0302-4e0c-a1e0-694c93e078b6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.444264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dc2dd-ebfd-4106-976a-f9b930ac0937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.447267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14dc2dd-ebfd-4106-976a-f9b930ac0937 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.454841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 823/1636] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:34.456160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.456579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.456827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.471705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60cfae-0302-4e0c-a1e0-694c93e078b6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.475740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:34.477174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:34.481712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.481712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.481712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.481712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.482074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.482428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.493463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 814/1637] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:34.497119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.562814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 824/1638] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:34.563646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.577156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268bb54-4603-4596-8071-84e3e1b75648 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.583768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.583768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.583768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.584341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] PATH_INFO: `/v3/projects/32b0b20d396e4439aaa42f4e2434a8e7/users/04f87438c6f740d591faf0371dd3a6ef/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.586905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0b20d396e4439aaa42f4e2434a8e7, user_id=04f87438c6f740d591faf0371dd3a6ef, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.590190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.602505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844940b-a697-43bf-94fb-0ebc5e8cadfa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.605464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 825/1639] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:34 2022] PUT /identity/v3/projects/32b0b20d396e4439aaa42f4e2434a8e7/users/04f87438c6f740d591faf0371dd3a6ef/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:34.614344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.694242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adcd3b-65eb-4381-b815-174a17063e8b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:34.701036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58cef-a184-4b72-a265-3723f3fb49fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.702289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58cef-a184-4b72-a265-3723f3fb49fe service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.702585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58cef-a184-4b72-a265-3723f3fb49fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.702868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58cef-a184-4b72-a265-3723f3fb49fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.710089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22407ea-8bb6-426c-ba68-4ae1e18c1864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:34.710808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22407ea-8bb6-426c-ba68-4ae1e18c1864 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.711430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22407ea-8bb6-426c-ba68-4ae1e18c1864 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.711851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22407ea-8bb6-426c-ba68-4ae1e18c1864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.803213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22407ea-8bb6-426c-ba68-4ae1e18c1864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.805115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22407ea-8bb6-426c-ba68-4ae1e18c1864 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.805421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58cef-a184-4b72-a265-3723f3fb49fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:34.806880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58cef-a184-4b72-a265-3723f3fb49fe service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:34.820295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 826/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:34.824657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.824657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.824657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.829225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 815/1641] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:34.850936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] MFA Rules not processed for user `04f87438c6f740d591faf0371dd3a6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:34.852371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:34.894414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe4d2-61c5-4df1-a086-bb70de7724f4 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.895177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe4d2-61c5-4df1-a086-bb70de7724f4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.895572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe4d2-61c5-4df1-a086-bb70de7724f4 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.897305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 816/1642] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 22:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:49:34.903328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fd8d-5a48-44e7-9a43-d0f6d7d7c0a5 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:34.903808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fd8d-5a48-44e7-9a43-d0f6d7d7c0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:34.904270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fd8d-5a48-44e7-9a43-d0f6d7d7c0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:34.928486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-45f9fd8d-5a48-44e7-9a43-d0f6d7d7c0a5 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:34.929585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-45f9fd8d-5a48-44e7-9a43-d0f6d7d7c0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:34.939775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 827/1643] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:34.946307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 817/1644] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:34.958193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:34.960434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:35.050592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b2444-5c14-4d2e-af0c-046b32809502 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:35.056025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a38e5-4d3a-4f66-90d8-2f7361c7ded5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:35.057091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a38e5-4d3a-4f66-90d8-2f7361c7ded5 service glance] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:35.057584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a38e5-4d3a-4f66-90d8-2f7361c7ded5 service glance] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:35.058032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a38e5-4d3a-4f66-90d8-2f7361c7ded5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:35.075366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a38e5-4d3a-4f66-90d8-2f7361c7ded5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:35.077634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a38e5-4d3a-4f66-90d8-2f7361c7ded5 service glance] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:35.092784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 828/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:35.509047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec9f8-f574-4c31-8218-f21154157153 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:35.509397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec9f8-f574-4c31-8218-f21154157153 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:35.509745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbec9f8-f574-4c31-8218-f21154157153 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:35.511261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 818/1646] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 22:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:49:35.520252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:35.520548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:35.520840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:35.585278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbec9f8-f574-4c31-8218-f21154157153 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:35.591984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:35.593511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:35.596839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbec9f8-f574-4c31-8218-f21154157153 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:35.602128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:35.602766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:35.603060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:35.603321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:35.615644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:35.616808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:35.629331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 819/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:35.670023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 829/1648] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:49:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:35.686075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:35.696962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8bc1-360d-41c8-be89-8ce8076165ff service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:35.701149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6488-ca59-49f6-9e74-52f63416f9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:35.701900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6488-ca59-49f6-9e74-52f63416f9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:35.702320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6488-ca59-49f6-9e74-52f63416f9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:35.702699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6488-ca59-49f6-9e74-52f63416f9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:35.712301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6488-ca59-49f6-9e74-52f63416f9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:35.713838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6488-ca59-49f6-9e74-52f63416f9cb service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:35.723673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 820/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:36.556708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:36.648835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c4709-6258-426c-b15d-73b5db7a5a97 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:36.649355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c4709-6258-426c-b15d-73b5db7a5a97 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:36.649789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c4709-6258-426c-b15d-73b5db7a5a97 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:36.653389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 821/1650] 10.222.0.23 () {54 vars in 960 bytes} [Tue May 3 22:49:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:49:36.659464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:36.660276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:36.660896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:36.670841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c5ec9-a285-455f-a13c-812ff2dff4d4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:36.690444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:36.692050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:36.696774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] MFA Rules not processed for user `166a670867884c689f3dd5c93b58b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:36.697247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:36.699564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] PATH_INFO: `/v3/users/3d5b568d681e489798c4ef805601ef6b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:36.700906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:36.704822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5b568d681e489798c4ef805601ef6b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:36.729485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:36.857505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 822/1651] 10.222.0.23 () {58 vars in 1057 bytes} [Tue May 3 22:49:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:36.868953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:36.889836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdec12-1a17-4d16-b0fb-0a60730b6214 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:36.898364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:36.899696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:36.899983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:36.900318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:36.902926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:36.933141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:36.935101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:36.946570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 823/1652] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:49:37.005864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5b568d681e489798c4ef805601ef6b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.130915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5b568d681e489798c4ef805601ef6b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.138500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:37.150621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5b568d681e489798c4ef805601ef6b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.152060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5b568d681e489798c4ef805601ef6b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.154208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ce35980d-1d97-49eb-9b0f-fa2d9b202df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5b568d681e489798c4ef805601ef6b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.161254 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5160c96-7bc5-4bae-a384-d112413ee827 service placement] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:37.181936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:37.182882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:37.183354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:37.183684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] PATH_INFO: `/v3/users/b7888d29b1f3444abb8fd9b39f2044d8` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:37.186499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7888d29b1f3444abb8fd9b39f2044d8)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:37.188088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: WARNING py.warnings [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:49:37.188088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: warnings.warn(msg) May 03 22:49:37.188088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: May 03 22:49:37.190678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:37.205760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 830/1653] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:49:36 2022] DELETE /identity/v3/users/3d5b568d681e489798c4ef805601ef6b => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:37.208150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:37.208562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:37.209037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:37.524935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:37.524935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:37.524935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 831/1654] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:37.524935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:37.524935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:37.533348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825d2f-430a-4b01-9a70-c2bcd8ee4e86 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:37.533348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5b064-36bf-43a3-b53b-2237527c1e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:37.533348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b064-36bf-43a3-b53b-2237527c1e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:37.533348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b064-36bf-43a3-b53b-2237527c1e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:37.534990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b064-36bf-43a3-b53b-2237527c1e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:37.534990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5b064-36bf-43a3-b53b-2237527c1e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:37.534990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5b064-36bf-43a3-b53b-2237527c1e29 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:37.557917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 832/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:37.604107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7888d29b1f3444abb8fd9b39f2044d8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.802818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7888d29b1f3444abb8fd9b39f2044d8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.857065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7888d29b1f3444abb8fd9b39f2044d8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.857826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7888d29b1f3444abb8fd9b39f2044d8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.914493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7888d29b1f3444abb8fd9b39f2044d8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:37.935525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 824/1656] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:49:37 2022] DELETE /identity/v3/users/b7888d29b1f3444abb8fd9b39f2044d8 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:49:37.945129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:37.945426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:37.945716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:37.996106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:37.996999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:38.143649 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 833/1657] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:38.223346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:38.223346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:38.388907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d97eb6-42ac-4e96-a3c4-22d9cf14b074 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:38.401771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cc63b-16ea-4a5c-a740-8b688c84e3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:38.402613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cc63b-16ea-4a5c-a740-8b688c84e3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:38.402907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cc63b-16ea-4a5c-a740-8b688c84e3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:38.419688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cc63b-16ea-4a5c-a740-8b688c84e3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:38.469329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cc63b-16ea-4a5c-a740-8b688c84e3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:38.472910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cc63b-16ea-4a5c-a740-8b688c84e3c0 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:38.506389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 825/1658] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:38.791819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:38.791819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:38.834559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de37312-eec2-477c-b889-d9d35513b32a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:38.846173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:38.847247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:38.847555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:38.847874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] PATH_INFO: `/v3/projects/a9a41f409d8c477fa7d0d7c9a49fda4a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:38.849152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a41f409d8c477fa7d0d7c9a49fda4a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:38.850177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: WARNING py.warnings [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 03 22:49:38.850177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: warnings.warn(msg) May 03 22:49:38.850177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: May 03 22:49:38.851582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.014315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a41f409d8c477fa7d0d7c9a49fda4a', 'request_id': 'req-da783fcf-3a19-4c6f-9342-04c5fdaacd54'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.024400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a41f409d8c477fa7d0d7c9a49fda4a', 'request_id': 'req-da783fcf-3a19-4c6f-9342-04c5fdaacd54'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.104220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a41f409d8c477fa7d0d7c9a49fda4a', 'request_id': 'req-da783fcf-3a19-4c6f-9342-04c5fdaacd54'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.132373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] The token cache is being invalidate because project a9a41f409d8c477fa7d0d7c9a49fda4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:49:39.132904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.134276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-da783fcf-3a19-4c6f-9342-04c5fdaacd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.136366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 834/1659] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:49:38 2022] DELETE /identity/v3/projects/a9a41f409d8c477fa7d0d7c9a49fda4a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:49:39.142647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.143834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.144521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.174039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:39.175268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:39.262685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 826/1660] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:39.270406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.270779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.271490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.292165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:39.293504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:39.310444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.311363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 835/1661] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:39.327649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4a112-f1fa-49a4-9251-e8ad8ed0155d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.333231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.334038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.334998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.336705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.336705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:39.336705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:39.339278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.363861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 827/1662] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:39.370716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.381688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe90ca9-c0e1-48bb-a01c-d3b6d412fed6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.382851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.384706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:39.395004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.396301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.396301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.396301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.397240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:39.399657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.402744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0dc32-8738-41da-8192-d2c6ef996b72 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.413334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.417263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.427229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.427229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] PATH_INFO: `/v3/projects/ce3c6882ccea47e8a23470dce6dfa70d` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.427229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3c6882ccea47e8a23470dce6dfa70d)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:39.427229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.536082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 836/1663] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:39 2022] POST /identity/v3/projects => generated 363 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:39.539906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.629284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3c6882ccea47e8a23470dce6dfa70d', 'request_id': 'req-ad8d59d1-8ecb-47b4-8511-de68167c98c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.637137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3c6882ccea47e8a23470dce6dfa70d', 'request_id': 'req-ad8d59d1-8ecb-47b4-8511-de68167c98c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.668854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368f2d-43c6-4ddc-be1a-acb8b967385a admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.731511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3c6882ccea47e8a23470dce6dfa70d', 'request_id': 'req-ad8d59d1-8ecb-47b4-8511-de68167c98c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.756082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] The token cache is being invalidate because project ce3c6882ccea47e8a23470dce6dfa70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:49:39.756364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.761779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:39.770296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 828/1664] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:49:39 2022] DELETE /identity/v3/projects/ce3c6882ccea47e8a23470dce6dfa70d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:39.772039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.775143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:39.782002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.783273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.786014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.786335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.787064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:39.789087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.805551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d59d1-8ecb-47b4-8511-de68167c98c4 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.820433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.828770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.828770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.828770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] PATH_INFO: `/v3/users/04f87438c6f740d591faf0371dd3a6ef` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.828770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f87438c6f740d591faf0371dd3a6ef)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:39.835358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.926623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 837/1665] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:39 2022] POST /identity/v3/users => generated 282 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:49:39.926623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.928616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:39.948113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b670-615e-42f1-bdfa-38de87096ffc admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.953340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.954807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:39.955146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:39.955430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:39.956451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:39.958208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:39.972308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 838/1666] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:39.977591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:39.989460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9190f-5c37-4583-af90-a8b26f71a527 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:39.998374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:39.999237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:40.001558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:40.002116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:40.003109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:40.005013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:40.027874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 839/1667] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:40.029177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:40.051457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe811-af56-4e21-90b8-2d19fc8acf42 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:40.068278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f3452-2e82-466f-830b-a9c6c37ae6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:40.071257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3452-2e82-466f-830b-a9c6c37ae6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:40.075795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3452-2e82-466f-830b-a9c6c37ae6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:40.076908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f3452-2e82-466f-830b-a9c6c37ae6cb admin admin] PATH_INFO: `/v3/projects/829ddd18148b426fa6d46a47e9d9a731/users/1c1f8fcc436347e6bf3dd555d3669108/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:40.114257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f87438c6f740d591faf0371dd3a6ef'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:40.142506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f3452-2e82-466f-830b-a9c6c37ae6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ddd18148b426fa6d46a47e9d9a731, user_id=1c1f8fcc436347e6bf3dd555d3669108, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:40.146094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f3452-2e82-466f-830b-a9c6c37ae6cb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:40.183059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f87438c6f740d591faf0371dd3a6ef'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:40.192547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f87438c6f740d591faf0371dd3a6ef'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:40.193451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f87438c6f740d591faf0371dd3a6ef'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:40.220702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f87438c6f740d591faf0371dd3a6ef'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:40.222528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 840/1668] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:40 2022] PUT /identity/v3/projects/829ddd18148b426fa6d46a47e9d9a731/users/1c1f8fcc436347e6bf3dd555d3669108/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:40.234392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:40.234672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:40.235160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:40.237503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 829/1669] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:49:39 2022] DELETE /identity/v3/users/04f87438c6f740d591faf0371dd3a6ef => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:40.312857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] MFA Rules not processed for user `1c1f8fcc436347e6bf3dd555d3669108`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:40.321843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:40.529245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 841/1670] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:40.539417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:40.541399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:40.851312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbc71f-2ba5-440d-b6ae-272eb3f8d6f8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:40.857371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:40.858206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:40.858491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:40.858898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:40.860255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:40.862915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:40.974539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 830/1671] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:40 2022] POST /identity/v3/projects => generated 363 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:40.978317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:40.993727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb05a-049a-46c7-bcfc-9d2b6abc42fd None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:41.109211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:41.110121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:41.111200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:41.111740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:41.113519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:41.115899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:41.227002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 842/1672] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:40 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:41.227084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:41.239778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454ef48-2784-4db8-acda-404bae3fdc16 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:41.245787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:41.247148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:41.249938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:41.250474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:41.251485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:41.257422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:41.286333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:41.298731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 831/1673] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:49:41.301491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a72e-271a-4002-9f66-bfbcf6f07fb0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:41.328112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:41.331509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:41.335302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:41.337291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] PATH_INFO: `/v3/projects/f0ac71dd262e4843971a5e1a1f2c4636/users/652724f22dd349f39993bd0cd3124ada/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:41.365421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ac71dd262e4843971a5e1a1f2c4636, user_id=652724f22dd349f39993bd0cd3124ada, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:41.369057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:41.455006 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 843/1674] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:41 2022] PUT /identity/v3/projects/f0ac71dd262e4843971a5e1a1f2c4636/users/652724f22dd349f39993bd0cd3124ada/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:49:41.459422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:41.485963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11917183-fad5-4c9f-87b1-f9f7ec4cc0c9 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:41.624394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:41.628175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:41.720902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:41.722752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:41.723041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:41.723641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:41.729761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:41.739781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:41.794179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 832/1675] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:41.798913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:41.849659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff29a51-0279-4b1a-945f-22b8c71b7e78 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:41.887953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be5ef3-3946-4a32-ba98-5c4122615502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:41.889449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5ef3-3946-4a32-ba98-5c4122615502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:41.894669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5ef3-3946-4a32-ba98-5c4122615502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:41.894669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5ef3-3946-4a32-ba98-5c4122615502 admin admin] PATH_INFO: `/v3/projects/f0ac71dd262e4843971a5e1a1f2c4636/users/652724f22dd349f39993bd0cd3124ada/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:41.904790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be5ef3-3946-4a32-ba98-5c4122615502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ac71dd262e4843971a5e1a1f2c4636, user_id=652724f22dd349f39993bd0cd3124ada, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:41.911673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be5ef3-3946-4a32-ba98-5c4122615502 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:41.924748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f1c5e-d512-4956-8ec7-1c42c9a8ea4a admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:41.953866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:41.953866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:41.953866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:41.953866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] PATH_INFO: `/v3/projects/32b0b20d396e4439aaa42f4e2434a8e7` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:41.954212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0b20d396e4439aaa42f4e2434a8e7)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:41.971178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:41.990747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 833/1676] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:41 2022] PUT /identity/v3/projects/f0ac71dd262e4843971a5e1a1f2c4636/users/652724f22dd349f39993bd0cd3124ada/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:42.000601 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.000994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.001768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.052298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] MFA Rules not processed for user `652724f22dd349f39993bd0cd3124ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:42.053786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.171811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0b20d396e4439aaa42f4e2434a8e7', 'request_id': 'req-aac3ae64-8c0a-486e-8bc3-354fa11706ac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:42.189463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0b20d396e4439aaa42f4e2434a8e7', 'request_id': 'req-aac3ae64-8c0a-486e-8bc3-354fa11706ac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:42.250060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 834/1677] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:42.256908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:42.259302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.286490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0b20d396e4439aaa42f4e2434a8e7', 'request_id': 'req-aac3ae64-8c0a-486e-8bc3-354fa11706ac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:42.305989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] The token cache is being invalidate because project 32b0b20d396e4439aaa42f4e2434a8e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:49:42.306307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:42.306970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-aac3ae64-8c0a-486e-8bc3-354fa11706ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:42.309560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 844/1678] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:49:41 2022] DELETE /identity/v3/projects/32b0b20d396e4439aaa42f4e2434a8e7 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:42.317280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.317588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.317845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.353205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:42.354735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.419713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37651671-ad0c-4eb2-828e-48b5d7a93c3d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:42.514640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 845/1679] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:42.515726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:42.519341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.537722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:42.538423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.542199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.542199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.545706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.620135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d15f5-992b-480c-ad0b-87f922e9afbd None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:42.624230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:42.628118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.628118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.628118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.628404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.669061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:42.673190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4cce9-d227-44e1-8a55-f2833c4b4c63 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:42.696360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 835/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:42.697954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.698247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.699959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.735236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:42.738611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:42.757757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 836/1681] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:42.764944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:42.767426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:42.769163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:42.795177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 846/1682] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:42.815685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2c3f-885c-4ef8-ae33-e6e25c7d7bd9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:42.831119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:42.831877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.832169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.834903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.835793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:42.836120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:42.837779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:42.878861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 837/1683] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:42.880043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:42.904528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921fdc-24d7-49cd-917f-f540994914e6 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:42.919137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:42.919778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:42.920068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:42.920347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:42.921065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:42.923032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:43.068328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:43.070318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:43.102504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 847/1684] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:42 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:43.114009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:43.150539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda92f0-5ec1-455b-b0ec-aeb10e4b8ff6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:43.334370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:43.336642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:43.337002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:43.337232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:43.340295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ba25-f379-4f3a-9fa9-72f290c0734f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:43.342257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:43.351146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:43.353178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:43.353459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:43.353736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:43.359496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:43.365188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:43.528912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 848/1685] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:43 2022] POST /identity/v3/users => generated 283 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:43.530632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:43.535405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:43.540999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:43.545607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43959a-4b62-49af-87dc-6eb053feaac5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:43.559654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:43.559895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:43.560185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:43.560463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:43.561434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:43.563133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:43.570121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 838/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:43.589432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 849/1687] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:43.593637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:43.634299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b18c2-4712-4bf3-8d7c-84ab14b75d70 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:43.640744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b3351-000f-4e53-b14d-fb59ffae5454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:43.640921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b3351-000f-4e53-b14d-fb59ffae5454 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:43.641188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b3351-000f-4e53-b14d-fb59ffae5454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:43.641461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b3351-000f-4e53-b14d-fb59ffae5454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:43.642237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b3351-000f-4e53-b14d-fb59ffae5454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:43.660081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b3351-000f-4e53-b14d-fb59ffae5454 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:43.700955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:43.710171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 839/1688] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:43.713330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64a0f2-4e8a-446e-b93b-b79322cae7ad admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:43.732887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:43.740373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:43.740373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:43.740373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] PATH_INFO: `/v3/projects/523dfa3dc1764e11bd6846a311997fa1/users/407ffd4da5f044b6b276704c85ab6bac/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:43.774915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=523dfa3dc1764e11bd6846a311997fa1, user_id=407ffd4da5f044b6b276704c85ab6bac, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:43.778133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:43.882618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 850/1689] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:43 2022] PUT /identity/v3/projects/523dfa3dc1764e11bd6846a311997fa1/users/407ffd4da5f044b6b276704c85ab6bac/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:43.893169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:43.893569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:43.893923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:43.977212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] MFA Rules not processed for user `407ffd4da5f044b6b276704c85ab6bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:43.978046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:44.161247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 840/1690] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:44.165762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:44.252842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817affdd-5ac8-4b56-8826-3000bb997a4b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:44.258369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:44.259393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:44.259925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:44.260398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:44.261414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:44.263588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:44.408225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 851/1691] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:44 2022] POST /identity/v3/projects => generated 363 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:44.409450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:44.425866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e901a5-6eed-4ba8-a163-3e7ca102bfc3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:44.558114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:44.559078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:44.559573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:44.560104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:44.561035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:44.564220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:44.695816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 841/1692] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:44 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:49:44.696820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:44.709411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41074e3-425a-47ed-b36f-9613d7486435 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:44.717280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:44.717963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:44.718300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:44.719209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:44.719313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:44.721538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:44.741279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 852/1693] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:44.744946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:44.764023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ee2b-c5ad-4f7e-99cb-f00e1a772450 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:44.777842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:44.779068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:44.795417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:44.795737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] PATH_INFO: `/v3/projects/26cf818b9e484af4907e60859546f09b/users/257f8c014b8a43d2ac309eb6000ebdf0/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:44.843482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cf818b9e484af4907e60859546f09b, user_id=257f8c014b8a43d2ac309eb6000ebdf0, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:44.846253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:44.977276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 842/1694] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:44 2022] PUT /identity/v3/projects/26cf818b9e484af4907e60859546f09b/users/257f8c014b8a43d2ac309eb6000ebdf0/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:44.978310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:45.006086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fbd98-81b5-4b7b-aa93-b90fdc1db710 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:45.179348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83984001-d7c0-4566-9d5a-92eb934fae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:45.180364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984001-d7c0-4566-9d5a-92eb934fae13 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:45.180796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984001-d7c0-4566-9d5a-92eb934fae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:45.181220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83984001-d7c0-4566-9d5a-92eb934fae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:45.182115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984001-d7c0-4566-9d5a-92eb934fae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:45.183952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83984001-d7c0-4566-9d5a-92eb934fae13 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:45.218533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 853/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:45.223042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:45.252142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef10f8b-6237-4eb9-84ea-3f99e3beb840 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:45.276390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d64b6-ddf3-4770-aaea-2e6ece26c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:45.277536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d64b6-ddf3-4770-aaea-2e6ece26c15c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:45.277896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d64b6-ddf3-4770-aaea-2e6ece26c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:45.278250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d64b6-ddf3-4770-aaea-2e6ece26c15c admin admin] PATH_INFO: `/v3/projects/26cf818b9e484af4907e60859546f09b/users/257f8c014b8a43d2ac309eb6000ebdf0/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:45.286664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d64b6-ddf3-4770-aaea-2e6ece26c15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cf818b9e484af4907e60859546f09b, user_id=257f8c014b8a43d2ac309eb6000ebdf0, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:45.296439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d64b6-ddf3-4770-aaea-2e6ece26c15c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:45.331893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 843/1696] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:45 2022] PUT /identity/v3/projects/26cf818b9e484af4907e60859546f09b/users/257f8c014b8a43d2ac309eb6000ebdf0/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:45.343285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:45.343721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:45.352654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:45.377894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:45.377894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:45.378655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:45.399463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] MFA Rules not processed for user `257f8c014b8a43d2ac309eb6000ebdf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:45.400866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:45.430483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] MFA Rules not processed for user `d7353d5eef814367844ffbb574c6a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:45.436526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:45.581254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 854/1697] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:45.593046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:45.638362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 844/1698] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:45.645036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:45.649229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:45.776677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379e6e1-5f6c-46db-9a6b-b42db1cf494b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:45.787637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e09cd-38a9-4c2c-b732-507362ed0a4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:45.788374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e09cd-38a9-4c2c-b732-507362ed0a4e service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:45.788655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e09cd-38a9-4c2c-b732-507362ed0a4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:45.788941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e09cd-38a9-4c2c-b732-507362ed0a4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:45.806938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e09cd-38a9-4c2c-b732-507362ed0a4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:45.808430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e09cd-38a9-4c2c-b732-507362ed0a4e service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:45.865805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 855/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:49:45.868800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6575770-e029-47b8-b2c5-0778dd5a25f4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:45.877768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:45.878885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:45.879174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:45.879452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:45.890485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:45.892685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:45.905065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 845/1700] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:46.015936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:46.017787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:46.018084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:46.064442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] MFA Rules not processed for user `dd0ac9313e0149bbaabbcbeaa35b1d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:46.089198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:46.213446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:46.227880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d42f7f-70f5-40b7-9c6b-6b9771327b68 service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:46.252176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be581151-4db9-41af-a52d-082fbc4f45b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:46.252842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be581151-4db9-41af-a52d-082fbc4f45b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:46.253125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be581151-4db9-41af-a52d-082fbc4f45b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:46.257793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be581151-4db9-41af-a52d-082fbc4f45b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:46.330691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 856/1701] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:46.355052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:46.356942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:46.388469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c5174-fc7a-489d-a52b-69e427e7e4be None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:46.409330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bbf36-c029-465a-a772-be58fcf5d757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:46.410563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbf36-c029-465a-a772-be58fcf5d757 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:46.411106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbf36-c029-465a-a772-be58fcf5d757 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:46.411698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbf36-c029-465a-a772-be58fcf5d757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:46.422319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be581151-4db9-41af-a52d-082fbc4f45b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:46.431831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be581151-4db9-41af-a52d-082fbc4f45b0 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:46.432477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bbf36-c029-465a-a772-be58fcf5d757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:46.436496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bbf36-c029-465a-a772-be58fcf5d757 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:46.461929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 857/1702] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:46.465647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 846/1703] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:47.835997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:47.836840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:47.837271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:47.875716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] MFA Rules not processed for user `28b935fbbbb143cd94c9b54cec888607`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:47.877238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:48.069571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 858/1704] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:48.081716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:48.082241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:48.082312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:48.106182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] MFA Rules not processed for user `28b935fbbbb143cd94c9b54cec888607`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:48.108544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:48.121921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 847/1705] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:48.131820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:48.158186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f3e6-0925-4c61-92ca-6e291fd84337 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:48.170550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25547b-821d-45fc-8270-1ce90f6f86a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:48.171527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25547b-821d-45fc-8270-1ce90f6f86a6 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:48.172039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25547b-821d-45fc-8270-1ce90f6f86a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:48.173780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25547b-821d-45fc-8270-1ce90f6f86a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:48.194565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25547b-821d-45fc-8270-1ce90f6f86a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:48.197659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25547b-821d-45fc-8270-1ce90f6f86a6 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:48.233631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 859/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:48.520472 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:48.522131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:48.663118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec69a6-3bb9-43ba-9754-2b80d1d31146 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:48.678933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:48.679866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:48.680150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:48.680424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] PATH_INFO: `/v3/users/1c1f8fcc436347e6bf3dd555d3669108` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:48.684981 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1f8fcc436347e6bf3dd555d3669108)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:48.689198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:48.974749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1f8fcc436347e6bf3dd555d3669108'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:49.097213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1f8fcc436347e6bf3dd555d3669108'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:49.122590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1f8fcc436347e6bf3dd555d3669108'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:49.123944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1f8fcc436347e6bf3dd555d3669108'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:49.182493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a975e137-d51e-405a-b074-216e2c0004f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1f8fcc436347e6bf3dd555d3669108'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:49.215904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 848/1707] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:49:48 2022] DELETE /identity/v3/users/1c1f8fcc436347e6bf3dd555d3669108 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:49.220862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:49.221309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:49.221421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:49.241764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9f97-2160-4516-804b-64f627d93963 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:49.242328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9f97-2160-4516-804b-64f627d93963 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:49.242989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a9f97-2160-4516-804b-64f627d93963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:49.274918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:49.278597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:49.298966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e27a9f97-2160-4516-804b-64f627d93963 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:49.305598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e27a9f97-2160-4516-804b-64f627d93963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:49.460482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 860/1708] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:49.467889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 849/1709] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:49:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:49.500861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:49.502477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:49.715238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ac3f1-8c62-48c4-82c8-4ef5df095a9e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:49.738031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463e2f4-3cba-4afc-ba2c-27423c649f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:49.738705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e2f4-3cba-4afc-ba2c-27423c649f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:49.738985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e2f4-3cba-4afc-ba2c-27423c649f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:49.739258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463e2f4-3cba-4afc-ba2c-27423c649f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:49.785802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463e2f4-3cba-4afc-ba2c-27423c649f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:49.792801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463e2f4-3cba-4afc-ba2c-27423c649f4a service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:49.833759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 861/1710] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:49.940076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80486b-cf7b-49d0-9fec-17c80db1d734 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:49.940491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80486b-cf7b-49d0-9fec-17c80db1d734 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:49.940960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80486b-cf7b-49d0-9fec-17c80db1d734 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:49.943713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 850/1711] 10.222.0.23 () {54 vars in 912 bytes} [Tue May 3 22:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:49:49.949163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:49.949450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:49.949731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:49.994882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:49.996138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:50.012473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 862/1712] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:49:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:50.058008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80486b-cf7b-49d0-9fec-17c80db1d734 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:50.060127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-fc80486b-cf7b-49d0-9fec-17c80db1d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:50.091764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:50.091764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:50.098352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80486b-cf7b-49d0-9fec-17c80db1d734 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:50.108915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:50.109580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:50.109857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:50.110130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:50.141658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:50.144324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:50.183290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 851/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:50.304681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a1a8d-8cba-41b5-ad92-68a88ffc128c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:50.323516 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:50.324230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:50.324672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:50.325089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:50.336739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:50.338524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:50.371114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 863/1714] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:49:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:49:51.771959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:51.773558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:51.802551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc1e3-ae45-41fd-947c-192bd28b4781 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:51.815406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:51.816330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:51.816607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:51.816876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] PATH_INFO: `/v3/users/7087797701f542b0b872f99450756910` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:51.820672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7087797701f542b0b872f99450756910)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:51.826388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:53.286596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:53.289191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:53.336591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab04e3-5c42-4b43-9e3d-e976118fe5fe service swift] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:53.353096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:53.355995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:53.357091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:53.357529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] PATH_INFO: `/v3/projects/829ddd18148b426fa6d46a47e9d9a731` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:53.362019 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829ddd18148b426fa6d46a47e9d9a731)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:53.371171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:53.516126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7087797701f542b0b872f99450756910'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.628605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7087797701f542b0b872f99450756910'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.634963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829ddd18148b426fa6d46a47e9d9a731', 'request_id': 'req-456f92ae-b168-4509-9a27-bb3a509f8de8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.646197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7087797701f542b0b872f99450756910'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.647989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7087797701f542b0b872f99450756910'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.649480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829ddd18148b426fa6d46a47e9d9a731', 'request_id': 'req-456f92ae-b168-4509-9a27-bb3a509f8de8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.695185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-520c3a18-b835-49cb-b32f-e467dd94760f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7087797701f542b0b872f99450756910'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.717793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 852/1715] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:49:51 2022] DELETE /identity/v3/users/7087797701f542b0b872f99450756910 => generated 0 bytes in 1946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:53.723800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8d355-bdf6-4c55-bf61-4369cf1fb7ba None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:53.725583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8d355-bdf6-4c55-bf61-4369cf1fb7ba None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:53.726035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8d355-bdf6-4c55-bf61-4369cf1fb7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:53.775916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829ddd18148b426fa6d46a47e9d9a731', 'request_id': 'req-456f92ae-b168-4509-9a27-bb3a509f8de8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.801358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] The token cache is being invalidate because project 829ddd18148b426fa6d46a47e9d9a731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:49:53.801698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.806701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:53.819595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 864/1716] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:49:53 2022] DELETE /identity/v3/projects/829ddd18148b426fa6d46a47e9d9a731 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:49:53.828889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:53.841914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:53.862057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-92b8d355-bdf6-4c55-bf61-4369cf1fb7ba None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:53.889175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-92b8d355-bdf6-4c55-bf61-4369cf1fb7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:54.067129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f92ae-b168-4509-9a27-bb3a509f8de8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:54.182787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 853/1717] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:54.190016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:54.190895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:54.192019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:54.256771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] MFA Rules not processed for user `28b935fbbbb143cd94c9b54cec888607`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:54.272597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:54.324119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:54.327873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:54.328513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:54.329089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] PATH_INFO: `/v3/users/652724f22dd349f39993bd0cd3124ada` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:54.334218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652724f22dd349f39993bd0cd3124ada)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:54.345771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:54.534035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 854/1718] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:54.539367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:54.539367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:54.627176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652724f22dd349f39993bd0cd3124ada'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:54.749962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652724f22dd349f39993bd0cd3124ada'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:54.765258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652724f22dd349f39993bd0cd3124ada'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:54.768158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652724f22dd349f39993bd0cd3124ada'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:54.770665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66f5b68c-36c1-444f-91d3-b8f87cb46310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652724f22dd349f39993bd0cd3124ada'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:54.830781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe91ee-5321-492c-8e34-3de50b6cb304 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:54.839574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:54.840409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:54.842286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:54.842903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:54.846464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:54.873685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 865/1719] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:49:53 2022] DELETE /identity/v3/users/652724f22dd349f39993bd0cd3124ada => generated 0 bytes in 1054 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:54.875095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:54.875332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:54.875619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:54.889514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:54.900296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:54.962839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 855/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:54.997807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] MFA Rules not processed for user `d7353d5eef814367844ffbb574c6a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:54.999296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:55.157794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 866/1721] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:56.188107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:56.189807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:56.213031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a7c85-446d-4b48-a45f-58c17e0036ad service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:56.304118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:56.304118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:56.346475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:56.348237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:56.348794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:56.349303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] PATH_INFO: `/v3/projects/f0ac71dd262e4843971a5e1a1f2c4636` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:56.350853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ac71dd262e4843971a5e1a1f2c4636)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:56.353318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:56.510429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ac71dd262e4843971a5e1a1f2c4636', 'request_id': 'req-6297c5e3-2538-471f-8268-c6037bd72504'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.518361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ac71dd262e4843971a5e1a1f2c4636', 'request_id': 'req-6297c5e3-2538-471f-8268-c6037bd72504'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.573865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea7670-765d-4e20-9eac-d91f6c8beb97 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:56.590494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ac71dd262e4843971a5e1a1f2c4636', 'request_id': 'req-6297c5e3-2538-471f-8268-c6037bd72504'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.626300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] The token cache is being invalidate because project f0ac71dd262e4843971a5e1a1f2c4636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:49:56.626594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.627438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6297c5e3-2538-471f-8268-c6037bd72504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.634211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 856/1722] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:49:56 2022] DELETE /identity/v3/projects/f0ac71dd262e4843971a5e1a1f2c4636 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:56.634211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091b80e-a905-4fb6-9679-d27123e056b6 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:56.634211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091b80e-a905-4fb6-9679-d27123e056b6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:56.634211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091b80e-a905-4fb6-9679-d27123e056b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:56.668455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e091b80e-a905-4fb6-9679-d27123e056b6 None None] MFA Rules not processed for user `dd0ac9313e0149bbaabbcbeaa35b1d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:56.670211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e091b80e-a905-4fb6-9679-d27123e056b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:56.679357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:56.680839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:56.681318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:56.681795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] PATH_INFO: `/v3/projects/54e7471a56604859b29e095bcd358a8b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:56.683445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e7471a56604859b29e095bcd358a8b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:56.690609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:56.804634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 857/1723] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:56.805980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb923c2d-25ad-4a5e-87c4-781cc3777973 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:56.806329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb923c2d-25ad-4a5e-87c4-781cc3777973 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:56.806642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb923c2d-25ad-4a5e-87c4-781cc3777973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:56.837816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e7471a56604859b29e095bcd358a8b', 'request_id': 'req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.844229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e7471a56604859b29e095bcd358a8b', 'request_id': 'req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.870635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bb923c2d-25ad-4a5e-87c4-781cc3777973 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:56.873399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bb923c2d-25ad-4a5e-87c4-781cc3777973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:56.920751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e7471a56604859b29e095bcd358a8b', 'request_id': 'req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.959507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] The token cache is being invalidate because project 54e7471a56604859b29e095bcd358a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:49:56.961627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.963626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f0e9b28e-c366-4ad0-b9d6-0fbe35065e8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:49:56.991668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 867/1724] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:49:56 2022] DELETE /identity/v3/projects/54e7471a56604859b29e095bcd358a8b => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:56.996553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4b0e-41f2-43c4-b823-f66162409430 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:56.998497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4b0e-41f2-43c4-b823-f66162409430 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.001255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b4b0e-41f2-43c4-b823-f66162409430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.043691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 858/1725] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:57.047196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.058995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.058995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.059948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ef1b4b0e-41f2-43c4-b823-f66162409430 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:57.059948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef1b4b0e-41f2-43c4-b823-f66162409430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:57.086099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 868/1726] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:57.091202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:57.092467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:57.094513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.095331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.095628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.113417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 859/1727] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:57.119936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.134506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613824-2cd9-4630-baf9-644ff48a94de None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.148582 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:57.151250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:57.152987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.153807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.154287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.154569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.157582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:57.157909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.160621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.181335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 869/1728] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:49:57.185363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.188903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 860/1729] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:49:57.192287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.206865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5aef4-f043-45c9-bdb6-f30a369aede2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.220627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.221907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.222984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae5d7-ad47-4cad-997c-47a631a402af None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.223433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.225542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.227014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.233590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.244059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.244908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.245015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.245267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.246008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:49:57.246313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.247951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.272607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 870/1730] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:49:57.276491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.296981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429decdf-8ae1-48a5-a773-e425630162ba admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.308921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.310224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.310670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.311101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.311974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.314578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.401556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 861/1731] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/projects => generated 389 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:57.406906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.445027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 871/1732] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/projects => generated 401 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:49:57.448285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.496944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3c831-134f-40ce-9986-9c1f87678382 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.616784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357eabb-dada-4f70-bc80-677ca299baf5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.633211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.633921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.634220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.639035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.639199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.649863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.655181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.655181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.655181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.655181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.655839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.658616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.741625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 872/1733] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/users => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:57.743201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.776545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ae509-80dd-46ae-af8c-792d3a31d334 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.792120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 862/1734] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/users => generated 295 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:57.796836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.808182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.811118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.811410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.813008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.817682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.819576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.839756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71b34a-ba3b-4adb-8687-2ab5cd76524b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.855306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9f857-facb-445e-9ec2-bfe8a18a7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.856066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9f857-facb-445e-9ec2-bfe8a18a7769 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.856752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9f857-facb-445e-9ec2-bfe8a18a7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.857042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9f857-facb-445e-9ec2-bfe8a18a7769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.857908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9f857-facb-445e-9ec2-bfe8a18a7769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.863031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9f857-facb-445e-9ec2-bfe8a18a7769 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.870963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 873/1735] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:49:57.872968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.897822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d407c-b5aa-44e4-948c-3ddef6f57234 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:57.903402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 863/1736] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:49:57.904774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.916713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.917220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:57.917655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.917921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:57.918368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:57.923410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:57.924343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:57.927010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:57.973972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 874/1737] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:57.973972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:57.983730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:57.990455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:58.021252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c068-9d85-438f-9d12-721ded3cf417 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:58.054332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:58.055036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.060591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.060591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.063963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:58.077304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:58.104945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 875/1738] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:58.105997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:58.136418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29453f-cc70-482f-a505-bef43e0d596e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:58.155201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:58.176212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.180043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.180043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] PATH_INFO: `/v3/projects/9ddbb87aa8694919b05bb5190681dab2/users/ae1f2dc6070f44548a47ce5e4410f20d/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.219664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 864/1739] 10.222.0.36 () {58 vars in 1015 bytes} [Tue May 3 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:58.221650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:58.224339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddbb87aa8694919b05bb5190681dab2, user_id=ae1f2dc6070f44548a47ce5e4410f20d, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:58.231985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:58.245321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9c5f-5ead-44eb-8b4e-7d7d5055d51f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:58.253834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32019c42-3b1b-4795-a8a7-e079da9b502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:58.255150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32019c42-3b1b-4795-a8a7-e079da9b502c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.255708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32019c42-3b1b-4795-a8a7-e079da9b502c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.260849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32019c42-3b1b-4795-a8a7-e079da9b502c admin admin] PATH_INFO: `/v3/projects/9824d8c8d29045158cfd9ac6cd965d53/users/14341630b1084ef6b264d6a3f0f6fd39/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.289914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32019c42-3b1b-4795-a8a7-e079da9b502c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9824d8c8d29045158cfd9ac6cd965d53, user_id=14341630b1084ef6b264d6a3f0f6fd39, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:58.303711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32019c42-3b1b-4795-a8a7-e079da9b502c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:58.352096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 876/1740] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:58 2022] PUT /identity/v3/projects/9ddbb87aa8694919b05bb5190681dab2/users/ae1f2dc6070f44548a47ce5e4410f20d/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:58.353065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:58.363164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:58.389245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 865/1741] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:58 2022] PUT /identity/v3/projects/9824d8c8d29045158cfd9ac6cd965d53/users/14341630b1084ef6b264d6a3f0f6fd39/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:58.401319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d8db3-36e5-4962-8244-5ffc4531ad44 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.401787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d8db3-36e5-4962-8244-5ffc4531ad44 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.402475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d8db3-36e5-4962-8244-5ffc4531ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.477736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6a1d8db3-36e5-4962-8244-5ffc4531ad44 None None] MFA Rules not processed for user `ae1f2dc6070f44548a47ce5e4410f20d`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:58.479726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6a1d8db3-36e5-4962-8244-5ffc4531ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:58.560844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88d4a6-b768-4872-85c7-b896d93555c4 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:58.640610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 866/1742] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:58.642185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b632-e339-401e-b132-901235020479 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.642480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b632-e339-401e-b132-901235020479 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.642756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b632-e339-401e-b132-901235020479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.694108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:58.696050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.696331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.696604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.699124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a484b632-e339-401e-b132-901235020479 None None] MFA Rules not processed for user `14341630b1084ef6b264d6a3f0f6fd39`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:49:58.703639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a484b632-e339-401e-b132-901235020479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:49:58.711174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:58.712674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:58.735238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 877/1743] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:49:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:49:58.736678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:58.867395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 867/1744] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:49:58.871631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484b632-e339-401e-b132-901235020479 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:58.891033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d092667-6d30-4996-98d8-4e6d5ea809fb service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:58.930726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:58.932155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:58.932520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:58.933537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:58.937286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:58.948552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.065665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484b632-e339-401e-b132-901235020479 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.084856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 878/1745] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:58 2022] POST /identity/v3/projects => generated 401 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:59.088885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.099776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.100482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.100828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.101030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.112294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.116527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.247547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 868/1746] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:49:58 2022] POST /identity/v3/projects => generated 389 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:49:59.252719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.292452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899dc7d-53e4-4020-a7af-32c26c7eabb7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.394329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df90a62-3c3d-476b-a493-6b5f75577897 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.407543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.412066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.412066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.412066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.412066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.413401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.466445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.467209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.467628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.467979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.468749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.471406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.570280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 869/1747] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:59 2022] POST /identity/v3/users => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:59.571351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.583493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 879/1748] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:49:59 2022] POST /identity/v3/users => generated 307 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:49:59.592185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.609914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b5851-f9db-41aa-9c3a-a5df21324fe7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.611737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f4bb6-7fc9-451c-9079-000814bbf50e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.623783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.623783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.623783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.623783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.624267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.628167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.631455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.632332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.632625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.634001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.635688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.642459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.672435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 880/1749] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:59.678165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.678806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 870/1750] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:49:59.688649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.704963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c075e-806b-4fc7-ab47-c0a2f3724683 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.716770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.717716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.718001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.718844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] PATH_INFO: `/v3/projects/70947a9bfba94ca7af25177d871593b3/users/46ffb72aaab94009a432901a702c69fe/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.740959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0ab3-c512-42b7-9a83-e8b7f16316d2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:49:59.748783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:49:59.749966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:49:59.750258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:49:59.750533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] PATH_INFO: `/v3/projects/c00888b377314af6b7aa1493899e3d20/users/1a39aad54e9e42ce81d99c29e5507b5f/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:49:59.761512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70947a9bfba94ca7af25177d871593b3, user_id=46ffb72aaab94009a432901a702c69fe, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.764347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.773220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00888b377314af6b7aa1493899e3d20, user_id=1a39aad54e9e42ce81d99c29e5507b5f, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:49:59.775930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:49:59.880873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 881/1751] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:59 2022] PUT /identity/v3/projects/70947a9bfba94ca7af25177d871593b3/users/46ffb72aaab94009a432901a702c69fe/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:59.884469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:49:59.904107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 871/1752] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:49:59 2022] PUT /identity/v3/projects/c00888b377314af6b7aa1493899e3d20/users/1a39aad54e9e42ce81d99c29e5507b5f/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:49:59.911142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.018453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817b15d-8906-419b-8b5d-8e2b9a662822 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.045185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54295-700f-4bf0-ae6d-4e320db90cee admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.057770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.058642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.059004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.059349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.060315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.062125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.079639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 872/1753] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:00.080612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.092320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.092999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.093283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.093559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.093670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4ecab-0d2f-4243-a294-d58eb396166d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.094512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.097196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.099531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f908bf-b5bb-4f64-9770-7a0d5b2e2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.100779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f908bf-b5bb-4f64-9770-7a0d5b2e2e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.100779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f908bf-b5bb-4f64-9770-7a0d5b2e2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.101156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f908bf-b5bb-4f64-9770-7a0d5b2e2e01 admin admin] PATH_INFO: `/v3/projects/c00888b377314af6b7aa1493899e3d20/users/1a39aad54e9e42ce81d99c29e5507b5f/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.103274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f908bf-b5bb-4f64-9770-7a0d5b2e2e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00888b377314af6b7aa1493899e3d20, user_id=1a39aad54e9e42ce81d99c29e5507b5f, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.107408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f908bf-b5bb-4f64-9770-7a0d5b2e2e01 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.113505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 882/1754] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:00.114638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.125194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40ccbf-c003-45b0-a3f5-f248beb2e3a2 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.134463 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b9a6a-39e3-4f4b-902d-3bdd12928975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.135464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9a6a-39e3-4f4b-902d-3bdd12928975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.135871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9a6a-39e3-4f4b-902d-3bdd12928975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.136253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b9a6a-39e3-4f4b-902d-3bdd12928975 admin admin] PATH_INFO: `/v3/projects/70947a9bfba94ca7af25177d871593b3/users/46ffb72aaab94009a432901a702c69fe/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.141229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b9a6a-39e3-4f4b-902d-3bdd12928975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70947a9bfba94ca7af25177d871593b3, user_id=46ffb72aaab94009a432901a702c69fe, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.141229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b9a6a-39e3-4f4b-902d-3bdd12928975 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.148811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 873/1755] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:00 2022] PUT /identity/v3/projects/c00888b377314af6b7aa1493899e3d20/users/1a39aad54e9e42ce81d99c29e5507b5f/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:00.163981 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.164403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.164755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.180666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 883/1756] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:00 2022] PUT /identity/v3/projects/70947a9bfba94ca7af25177d871593b3/users/46ffb72aaab94009a432901a702c69fe/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:00.191849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.191849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.192033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.220832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] MFA Rules not processed for user `46ffb72aaab94009a432901a702c69fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:00.222403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:00.224941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] MFA Rules not processed for user `1a39aad54e9e42ce81d99c29e5507b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:00.226210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:00.352401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 884/1757] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:00.362181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.364884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:00.406751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 874/1758] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:00.422275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.425842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:00.514739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7cd6-dec3-43e8-ad66-3e329b6d779d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.520331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.521324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.521836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.522330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.536522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.536891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6e80d-1b91-4e2d-8ac2-a912f6e2da79 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.538515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.541482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.546141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.546141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.546141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.554172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.555647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.563052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 885/1759] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:00.587907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 875/1760] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:00.746480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.843657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb37a4-ec3a-431c-8f83-6007454c98db service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.850193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.851400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.851879 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.852342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] PATH_INFO: `/v3/users/14341630b1084ef6b264d6a3f0f6fd39` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:00.854125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=14341630b1084ef6b264d6a3f0f6fd39)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:00.864267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:00.889500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:00.900729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51078810-a23f-4a61-9019-195732da9024 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:00.911370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60beaebd-30ac-4dd3-8e90-caf880220ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:00.912061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beaebd-30ac-4dd3-8e90-caf880220ece service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:00.912338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beaebd-30ac-4dd3-8e90-caf880220ece service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:00.912619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60beaebd-30ac-4dd3-8e90-caf880220ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:01.021669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60beaebd-30ac-4dd3-8e90-caf880220ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:01.023147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60beaebd-30ac-4dd3-8e90-caf880220ece service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:01.045797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 876/1761] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:01.048285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a5af-6fa1-4a91-8201-5e3c9a5ec7f4 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:01.048583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a5af-6fa1-4a91-8201-5e3c9a5ec7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:01.048867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a5af-6fa1-4a91-8201-5e3c9a5ec7f4 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:01.053683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 877/1762] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:50:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:50:01.057687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f108-1c01-4da2-ab22-8e7e081aeb1f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:01.058046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f108-1c01-4da2-ab22-8e7e081aeb1f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:01.058344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7f108-1c01-4da2-ab22-8e7e081aeb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:01.111255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-cbf7f108-1c01-4da2-ab22-8e7e081aeb1f None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:01.115351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14341630b1084ef6b264d6a3f0f6fd39'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:01.116004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-cbf7f108-1c01-4da2-ab22-8e7e081aeb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:01.234661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14341630b1084ef6b264d6a3f0f6fd39'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:01.265029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14341630b1084ef6b264d6a3f0f6fd39'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:01.268630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14341630b1084ef6b264d6a3f0f6fd39'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:01.285749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 878/1763] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:01.292301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14341630b1084ef6b264d6a3f0f6fd39'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:01.324554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 886/1764] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:00 2022] DELETE /identity/v3/users/14341630b1084ef6b264d6a3f0f6fd39 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:01.329528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:01.330091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:01.330601 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:01.354229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:01.355566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:01.437679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:01.439349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:01.461307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 879/1765] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:01.472644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:01.475794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:01.527528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49515b-27fb-4d85-ae08-7ce6e59d68cd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:01.533700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:01.534349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:01.534635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:01.534915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:01.543932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:01.546426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:01.546531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286efc5-5793-4f02-9aaf-0763fef37c77 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:01.549398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:01.550034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:01.550316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:01.550590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:01.556185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 887/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:01.559677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:01.561093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:01.570681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 880/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:02.018456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:02.020001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:02.046567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455fb95-84a9-463f-bea0-b32a16e5d23d service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:02.051985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:02.052841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:02.053128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:02.053408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] PATH_INFO: `/v3/projects/9824d8c8d29045158cfd9ac6cd965d53` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:02.054584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9824d8c8d29045158cfd9ac6cd965d53)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:02.056538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:02.174127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9824d8c8d29045158cfd9ac6cd965d53', 'request_id': 'req-11efdfae-144b-4ffc-8093-e4e23ff529bd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.178849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9824d8c8d29045158cfd9ac6cd965d53', 'request_id': 'req-11efdfae-144b-4ffc-8093-e4e23ff529bd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.269454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9824d8c8d29045158cfd9ac6cd965d53', 'request_id': 'req-11efdfae-144b-4ffc-8093-e4e23ff529bd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.306175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] The token cache is being invalidate because project 9824d8c8d29045158cfd9ac6cd965d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:02.306476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.309901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.318566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 888/1768] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:02 2022] DELETE /identity/v3/projects/9824d8c8d29045158cfd9ac6cd965d53 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:02.322446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:02.334353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a573-1c3b-41fe-97c2-15387df850d3 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:02.436635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:02.437599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:02.437967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:02.438370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] PATH_INFO: `/v3/users/1a39aad54e9e42ce81d99c29e5507b5f` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:02.440530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a39aad54e9e42ce81d99c29e5507b5f)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:02.442559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:02.722935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a39aad54e9e42ce81d99c29e5507b5f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.822862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a39aad54e9e42ce81d99c29e5507b5f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.831935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a39aad54e9e42ce81d99c29e5507b5f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.832672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a39aad54e9e42ce81d99c29e5507b5f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.852994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6ab3996b-5664-4195-93a3-371d2ad462b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a39aad54e9e42ce81d99c29e5507b5f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:02.875059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 881/1769] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:02 2022] DELETE /identity/v3/users/1a39aad54e9e42ce81d99c29e5507b5f => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:04.253623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:04.255728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:04.269404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efdfae-144b-4ffc-8093-e4e23ff529bd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:04.351580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:04.354454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:04.355589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:04.356542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] PATH_INFO: `/v3/projects/c00888b377314af6b7aa1493899e3d20` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:04.365477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00888b377314af6b7aa1493899e3d20)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:04.367790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:04.540088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00888b377314af6b7aa1493899e3d20', 'request_id': 'req-eee12a25-290b-403f-ada4-1d99818838b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:04.545476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00888b377314af6b7aa1493899e3d20', 'request_id': 'req-eee12a25-290b-403f-ada4-1d99818838b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:04.687437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00888b377314af6b7aa1493899e3d20', 'request_id': 'req-eee12a25-290b-403f-ada4-1d99818838b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:04.708488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] The token cache is being invalidate because project c00888b377314af6b7aa1493899e3d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:04.708876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:04.710319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-eee12a25-290b-403f-ada4-1d99818838b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:04.715660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 889/1770] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:04 2022] DELETE /identity/v3/projects/c00888b377314af6b7aa1493899e3d20 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:04.719263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:04.721482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:04.721482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:04.742038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:04.743348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:04.829634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 882/1771] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:04.830570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:04.830873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:04.831184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:04.867219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:04.873742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:04.920192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 890/1772] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:04.925761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:04.938645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a672e5-ad8f-495f-a208-8e53eca74726 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:04.946095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:04.947036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:04.947379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:04.948571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:04.949706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:04.950078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:04.953587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:04.981467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 883/1773] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:04.986219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:04.997576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289b1d0-a745-4d18-92cc-4a1ec063fd72 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:05.002806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:05.003465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:05.003775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:05.004052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:05.004886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:05.006818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:05.117272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 891/1774] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:04 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:05.119002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:05.130677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde37b-7393-4699-aa3f-11755a575c1d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:05.215812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:05.216687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:05.217802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:05.218301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:05.219489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:05.222115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:05.326792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 884/1775] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:05 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:05.332484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:05.342801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c91270-0463-48d6-970b-b4b633772040 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:05.348545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:05.349494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:05.349873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:05.350251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:05.351083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:05.352849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:05.369326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 892/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:05.370387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:05.383381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000215c-0caa-463d-853d-7c3fa4e17bdf admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:05.389737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a4483-e887-4cb2-ac9f-b8306768b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:05.390953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a4483-e887-4cb2-ac9f-b8306768b2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:05.391474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a4483-e887-4cb2-ac9f-b8306768b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:05.392006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a4483-e887-4cb2-ac9f-b8306768b2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:05.392994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a4483-e887-4cb2-ac9f-b8306768b2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:05.395109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a4483-e887-4cb2-ac9f-b8306768b2fa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:05.415473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 885/1777] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:05.416688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:05.439485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b3e95-05f6-4e88-a8ae-ad8b61b13dca admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:05.456942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:05.457790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:05.458064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:05.458344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] PATH_INFO: `/v3/projects/42e6485b65d04243bcc669bcb2c88ce1/users/238d8fe440bb4ce5a179647cbf3ab5ca/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:05.501136 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e6485b65d04243bcc669bcb2c88ce1, user_id=238d8fe440bb4ce5a179647cbf3ab5ca, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:05.504864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:05.673523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 893/1778] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:05 2022] PUT /identity/v3/projects/42e6485b65d04243bcc669bcb2c88ce1/users/238d8fe440bb4ce5a179647cbf3ab5ca/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:05.680402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:05.680701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:05.680987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:05.801906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] MFA Rules not processed for user `238d8fe440bb4ce5a179647cbf3ab5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:05.804742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:05.950355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 886/1779] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:05.955049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:06.139664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f6a6-df5f-4db3-b5eb-929c03a7a273 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:06.165372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:06.172303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:06.172703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:06.173690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:06.174415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:06.178316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:06.334330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 894/1780] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:05 2022] POST /identity/v3/projects => generated 379 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:06.337925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:06.361003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6c1b4-ab0e-4faf-84c4-fdd056e796b0 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:06.436605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:06.437503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:06.437952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:06.439666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:06.441769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:06.445223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:06.668517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 887/1781] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:06 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:06.669277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:06.683360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12fd2e-95a3-4625-bc82-7647920483f0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:06.689932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:06.690600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:06.690885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:06.691159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:06.691926 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:06.693544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:06.705422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 895/1782] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:06.710514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:06.726577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6c1f-eade-4acc-adf7-cccc93bffe06 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:06.733221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c373-d571-4f5a-a233-25ac99a17469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:06.733904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c373-d571-4f5a-a233-25ac99a17469 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:06.734354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c373-d571-4f5a-a233-25ac99a17469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:06.734632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c373-d571-4f5a-a233-25ac99a17469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:06.735947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c373-d571-4f5a-a233-25ac99a17469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:06.738373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c373-d571-4f5a-a233-25ac99a17469 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:06.762051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 888/1783] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:06.769576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:06.782198 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec02a6e-84e4-4177-ab0b-6ae4c8f99531 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:06.794055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:06.795185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:06.796428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:06.797259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] PATH_INFO: `/v3/projects/bee7315821eb41c38de278205bd2d210/users/ca7880bf985d40cb875bd9b6b58514c9/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:06.815152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee7315821eb41c38de278205bd2d210, user_id=ca7880bf985d40cb875bd9b6b58514c9, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:06.819616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:06.893332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 896/1784] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:06 2022] PUT /identity/v3/projects/bee7315821eb41c38de278205bd2d210/users/ca7880bf985d40cb875bd9b6b58514c9/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:06.905792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:06.906748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:06.907211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:06.943100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] MFA Rules not processed for user `ca7880bf985d40cb875bd9b6b58514c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:06.945796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:07.031373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 889/1785] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:07.034004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.104040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bad9e3-8727-4859-8585-223f8589bef0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.111764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.119803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.119803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.119803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.119803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.119803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.243436 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.245095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 897/1786] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:07 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:07.261873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e48d-4316-4caf-aeaf-c1c4c099c6df None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.357661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.358392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.358695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.359012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.364695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.364695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.463478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 890/1787] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:07 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:07.467652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.479372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b821e3-2659-4d93-8bb7-f0b6e251ad38 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.484111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.484777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.485108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.485390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.486124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.487773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.498528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 898/1788] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:07.502739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.512508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1af0d-3d49-422b-b31d-103394f5a555 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.518028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.518949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.519196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.519469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] PATH_INFO: `/v3/projects/25ee3cb4498548c99b1d6128c3f196d9/users/2e765b4e988b4e6ab88dbc3d17e196dc/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.539065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ee3cb4498548c99b1d6128c3f196d9, user_id=2e765b4e988b4e6ab88dbc3d17e196dc, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.539065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.625000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.626880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:07.647841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb085f88-7bf0-4f2c-af77-f2a42c2c20e1 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.652842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.654004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.654491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.654940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] PATH_INFO: `/v3/users/ae1f2dc6070f44548a47ce5e4410f20d` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.656201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1f2dc6070f44548a47ce5e4410f20d)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.658928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.668507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 891/1789] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:07 2022] PUT /identity/v3/projects/25ee3cb4498548c99b1d6128c3f196d9/users/2e765b4e988b4e6ab88dbc3d17e196dc/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:07.672303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.748910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0e9e-7d7a-4e22-92da-908e8eef0a9c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.751530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.752319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.752801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.753135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.753996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.755810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.768161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 892/1790] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:07.772568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.783870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468cc1f-ddfd-4e84-adae-787b6e364383 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:07.789214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e01e95-9e5c-4a40-9a2e-f51cd98bc070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:07.790087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e01e95-9e5c-4a40-9a2e-f51cd98bc070 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.790364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e01e95-9e5c-4a40-9a2e-f51cd98bc070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.790635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e01e95-9e5c-4a40-9a2e-f51cd98bc070 admin admin] PATH_INFO: `/v3/projects/25ee3cb4498548c99b1d6128c3f196d9/users/2e765b4e988b4e6ab88dbc3d17e196dc/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.792626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e01e95-9e5c-4a40-9a2e-f51cd98bc070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ee3cb4498548c99b1d6128c3f196d9, user_id=2e765b4e988b4e6ab88dbc3d17e196dc, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:07.795566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e01e95-9e5c-4a40-9a2e-f51cd98bc070 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:07.806503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 893/1791] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:07 2022] PUT /identity/v3/projects/25ee3cb4498548c99b1d6128c3f196d9/users/2e765b4e988b4e6ab88dbc3d17e196dc/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:07.817458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:07.817746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:07.818024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:07.846276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] MFA Rules not processed for user `2e765b4e988b4e6ab88dbc3d17e196dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:07.847491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:07.883134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1f2dc6070f44548a47ce5e4410f20d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:07.941499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 894/1792] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:07.948809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1f2dc6070f44548a47ce5e4410f20d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:07.953515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:07.955721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:07.960109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1f2dc6070f44548a47ce5e4410f20d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:07.961126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1f2dc6070f44548a47ce5e4410f20d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:07.962069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e664faf0-d7b8-4901-9c90-fc6f5370ab14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1f2dc6070f44548a47ce5e4410f20d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:07.997305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 899/1793] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:07 2022] DELETE /identity/v3/users/ae1f2dc6070f44548a47ce5e4410f20d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:08.002884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.003452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.003756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.027238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:08.028632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.047945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08d3b-9f76-4fe2-9a50-178406693f89 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:08.094562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 900/1794] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:08.104333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:08.105725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.111898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:08.112882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.113320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.113611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.115576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.164778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ba8a5-0478-4fa6-a1a5-9e7b559ab4f8 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:08.168421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:08.169068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.169466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.169748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.179751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:08.181180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:08.184414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:08.185951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:08.195818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 901/1795] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:08.197218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:08.197316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 895/1796] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:08.198795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.214471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef399a27-a77e-488f-adce-98a357378f16 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:08.224256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:08.226116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.233537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.233537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] PATH_INFO: `/v3/users/407ffd4da5f044b6b276704c85ab6bac` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.233537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=407ffd4da5f044b6b276704c85ab6bac)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:08.234469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:08.315704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:08.317163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.328120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1128d4-249d-4142-bbfc-8358817ab4ae service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:08.332243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:08.332868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.333149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.333422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.335144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.401894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:08.403340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426c260-58a8-41ee-95c1-a786af58d424 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:08.416247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 896/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:08.422173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407ffd4da5f044b6b276704c85ab6bac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.541211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407ffd4da5f044b6b276704c85ab6bac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.549245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407ffd4da5f044b6b276704c85ab6bac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.549963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407ffd4da5f044b6b276704c85ab6bac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.550590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407ffd4da5f044b6b276704c85ab6bac'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.570773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 902/1798] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:08 2022] DELETE /identity/v3/users/407ffd4da5f044b6b276704c85ab6bac => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:08.573553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.573849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.574127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.595855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:08.597066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.658929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:08.660696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.663914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 897/1799] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:08.675514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:08.677077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:08.687421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e39b8-45fd-419d-b688-03cb66805553 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:08.703517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:08.704973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.705261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.705952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] PATH_INFO: `/v3/projects/9ddbb87aa8694919b05bb5190681dab2` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.707555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddbb87aa8694919b05bb5190681dab2)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:08.709649 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:08.735791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a254ca4-870e-4ff9-8492-df23c550ae7d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:08.739380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:08.740060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:08.740344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:08.740620 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:08.749777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:08.751792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:08.761331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 898/1800] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:08.869601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddbb87aa8694919b05bb5190681dab2', 'request_id': 'req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.875346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddbb87aa8694919b05bb5190681dab2', 'request_id': 'req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.964128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddbb87aa8694919b05bb5190681dab2', 'request_id': 'req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.982488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] The token cache is being invalidate because project 9ddbb87aa8694919b05bb5190681dab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:08.983241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.983461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:08.986035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 903/1801] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:08 2022] DELETE /identity/v3/projects/9ddbb87aa8694919b05bb5190681dab2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:08.994528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:09.006478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b231c31-3804-4944-add7-8ad744a74b84 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:09.066339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:09.067387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:09.067574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:09.067862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] PATH_INFO: `/v3/users/46ffb72aaab94009a432901a702c69fe` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:09.069131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ffb72aaab94009a432901a702c69fe)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:09.071560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:09.257619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ffb72aaab94009a432901a702c69fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.347636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ffb72aaab94009a432901a702c69fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.355505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:09.357031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:09.357634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ffb72aaab94009a432901a702c69fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.358416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ffb72aaab94009a432901a702c69fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.382426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeaeeb-3ff7-493d-8334-74ca23b8edd0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:09.397961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:09.398862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:09.399148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:09.399424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] PATH_INFO: `/v3/projects/523dfa3dc1764e11bd6846a311997fa1` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:09.400186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ffb72aaab94009a432901a702c69fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.412988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523dfa3dc1764e11bd6846a311997fa1)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:09.412988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:09.413141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 899/1802] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:08 2022] DELETE /identity/v3/users/46ffb72aaab94009a432901a702c69fe => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:09.541281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523dfa3dc1764e11bd6846a311997fa1', 'request_id': 'req-794efc72-b713-4cb1-845e-d88e8f1ef110'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.547287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523dfa3dc1764e11bd6846a311997fa1', 'request_id': 'req-794efc72-b713-4cb1-845e-d88e8f1ef110'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.681237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523dfa3dc1764e11bd6846a311997fa1', 'request_id': 'req-794efc72-b713-4cb1-845e-d88e8f1ef110'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.693798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] The token cache is being invalidate because project 523dfa3dc1764e11bd6846a311997fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:09.694405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.695462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:09.697872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 904/1803] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:09 2022] DELETE /identity/v3/projects/523dfa3dc1764e11bd6846a311997fa1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:09.701997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:09.708485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:09.798003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d1073-ba37-42fe-8687-ecc47e3dccfe admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:09.866087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:09.866961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:09.867437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:09.867753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] PATH_INFO: `/v3/users/257f8c014b8a43d2ac309eb6000ebdf0` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:09.868949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257f8c014b8a43d2ac309eb6000ebdf0)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:09.870863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:10.060049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257f8c014b8a43d2ac309eb6000ebdf0'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.137508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257f8c014b8a43d2ac309eb6000ebdf0'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.146763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257f8c014b8a43d2ac309eb6000ebdf0'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.147633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257f8c014b8a43d2ac309eb6000ebdf0'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.161289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aceab48c-429c-4846-8049-4ee2c1a57448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257f8c014b8a43d2ac309eb6000ebdf0'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.170387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 900/1804] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:09 2022] DELETE /identity/v3/users/257f8c014b8a43d2ac309eb6000ebdf0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:10.607525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:10.609105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:10.626507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794efc72-b713-4cb1-845e-d88e8f1ef110 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:10.737159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:10.738329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:10.738811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:10.739285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] PATH_INFO: `/v3/projects/70947a9bfba94ca7af25177d871593b3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:10.740735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70947a9bfba94ca7af25177d871593b3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:10.742847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:10.856668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70947a9bfba94ca7af25177d871593b3', 'request_id': 'req-0553f14e-7aa8-42f2-8012-e7c0752c85e9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.872992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70947a9bfba94ca7af25177d871593b3', 'request_id': 'req-0553f14e-7aa8-42f2-8012-e7c0752c85e9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:10.991973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70947a9bfba94ca7af25177d871593b3', 'request_id': 'req-0553f14e-7aa8-42f2-8012-e7c0752c85e9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.009340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] The token cache is being invalidate because project 70947a9bfba94ca7af25177d871593b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:11.009659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.010315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.016039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 905/1805] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:10 2022] DELETE /identity/v3/projects/70947a9bfba94ca7af25177d871593b3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:11.017569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f889e4-1cdb-433b-9c95-8e15d91898a8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.017928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f889e4-1cdb-433b-9c95-8e15d91898a8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.018272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f889e4-1cdb-433b-9c95-8e15d91898a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.043114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d6f889e4-1cdb-433b-9c95-8e15d91898a8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:11.045781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d6f889e4-1cdb-433b-9c95-8e15d91898a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:11.117041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.126822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:11.180913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 901/1806] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:11.189774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.190127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.190474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.211024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:11.213389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:11.222613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553f14e-7aa8-42f2-8012-e7c0752c85e9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.230268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 902/1807] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:11.232832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.233979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.236297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.241548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.241548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] PATH_INFO: `/v3/projects/26cf818b9e484af4907e60859546f09b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.244097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cf818b9e484af4907e60859546f09b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.246210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.254086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc00e4-d1dd-426a-9614-9aedf6eaf5e6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.281502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.282594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.283289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.283762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.285616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:11.285937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.288899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.302381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 903/1808] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:11.307124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.329314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d09ef-0944-4f94-a7df-856a75aef2fb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.335518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.336930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.337388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.337683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.338496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.341106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.371170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cf818b9e484af4907e60859546f09b', 'request_id': 'req-96c22ecd-e465-4be6-8ca9-75332cd8b718'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.386992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cf818b9e484af4907e60859546f09b', 'request_id': 'req-96c22ecd-e465-4be6-8ca9-75332cd8b718'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.446704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 904/1809] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:11.451509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.457495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cf818b9e484af4907e60859546f09b', 'request_id': 'req-96c22ecd-e465-4be6-8ca9-75332cd8b718'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.478112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] The token cache is being invalidate because project 26cf818b9e484af4907e60859546f09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:11.478622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.479860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-96c22ecd-e465-4be6-8ca9-75332cd8b718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:11.482123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 906/1810] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:11 2022] DELETE /identity/v3/projects/26cf818b9e484af4907e60859546f09b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:11.491019 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059606a2-fdf3-44ac-92be-a5e101056634 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.491898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059606a2-fdf3-44ac-92be-a5e101056634 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.492648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059606a2-fdf3-44ac-92be-a5e101056634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.541425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-059606a2-fdf3-44ac-92be-a5e101056634 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:11.543003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-059606a2-fdf3-44ac-92be-a5e101056634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:11.586027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9508b71-e3a7-4cd3-858a-c59c529c8aa2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.602373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.603489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.603955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.604373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.605232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.607364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.641646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 907/1811] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:11.649020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.649380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.653026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.679042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:11.680623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:11.693706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 908/1812] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:11.700058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.724698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ac27b-63fe-4b8c-9965-18c6d05bfd4b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.729452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 905/1813] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/users => generated 294 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:11.734246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.736043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:11.737044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.737725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.738046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.738278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.739018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:11.739404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.741238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.767743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3c890-5f47-4ef8-9369-33cb39a129a8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.771837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 909/1814] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:11.775657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.776228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.778347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.778638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.779824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.780587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.784366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.790656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a923a0f7-a24d-48fb-89c1-6775e6402a96 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.806247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 906/1815] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:11.817561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.822986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42bc3f-c0dc-4fbe-87ff-19ace9ca1873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.823965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42bc3f-c0dc-4fbe-87ff-19ace9ca1873 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.824387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42bc3f-c0dc-4fbe-87ff-19ace9ca1873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.830999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42bc3f-c0dc-4fbe-87ff-19ace9ca1873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.830999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42bc3f-c0dc-4fbe-87ff-19ace9ca1873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.830999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42bc3f-c0dc-4fbe-87ff-19ace9ca1873 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.847023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2f5f-312d-425c-80cd-65d1dd7791df admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.853077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.854186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.854651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.860493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.860493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:11.860493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:11.874394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 907/1816] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:11.892890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:11.935844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e611f-550a-4b15-beec-21c71b9c75ca admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:11.960377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d8e4-b4c6-4432-a3a1-47d7f3a90432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:11.961299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d8e4-b4c6-4432-a3a1-47d7f3a90432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.961582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d8e4-b4c6-4432-a3a1-47d7f3a90432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.961857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d8e4-b4c6-4432-a3a1-47d7f3a90432 admin admin] PATH_INFO: `/v3/projects/c77d0161a1a046bb94c66c2d2fdd9b25/users/b89e7986c4f54fca8d856a64253613cb/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.975117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 910/1817] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:11.976340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68de0d-e5a3-4248-923a-92cf50c11fc7 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:11.976634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68de0d-e5a3-4248-923a-92cf50c11fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:11.978766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68de0d-e5a3-4248-923a-92cf50c11fc7 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:11.982437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 911/1818] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:50:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:50:11.983430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68de0d-e5a3-4248-923a-92cf50c11fc7 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.051914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d8e4-b4c6-4432-a3a1-47d7f3a90432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77d0161a1a046bb94c66c2d2fdd9b25, user_id=b89e7986c4f54fca8d856a64253613cb, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.054672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d8e4-b4c6-4432-a3a1-47d7f3a90432 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.217505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 908/1819] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:11 2022] PUT /identity/v3/projects/c77d0161a1a046bb94c66c2d2fdd9b25/users/b89e7986c4f54fca8d856a64253613cb/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:12.219225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00103b8e-114e-4362-ac1d-01e231d02694 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.220087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00103b8e-114e-4362-ac1d-01e231d02694 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.220368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00103b8e-114e-4362-ac1d-01e231d02694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.258641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68de0d-e5a3-4248-923a-92cf50c11fc7 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:12.279407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-00103b8e-114e-4362-ac1d-01e231d02694 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:12.280682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-00103b8e-114e-4362-ac1d-01e231d02694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:12.436715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:12.440653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.441266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.441742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.443261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.446025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.464498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 909/1820] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:12.468728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.470693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.471568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.526457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] MFA Rules not processed for user `b89e7986c4f54fca8d856a64253613cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:12.528054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:12.567233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 912/1821] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:11 2022] POST /identity/v3/users => generated 284 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:12.568993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.588877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702ae6c-3102-4d1e-8511-38844da27b75 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:12.600767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:12.601510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.601902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.602247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.603049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.604748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.627995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 913/1822] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:12.631817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.634708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:12.645830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 910/1823] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:12.646715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.658583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd8fdd-aa7f-426c-99db-702a28ba93c8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:12.659293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001944e8-6abe-4d40-90b1-e5eefd841f84 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:12.664736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:12.665293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:12.665410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.665700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.665980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.670572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.673795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.674264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.675207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.677108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.684390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.686005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.700681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 911/1824] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:12.700881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 914/1825] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:12.701842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.706617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.723795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc35a-5a84-4a02-895f-e66cdf563f02 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:12.732223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:12.732907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.733192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.733476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.740110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.744480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.746739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506401b8-4cf4-428a-ab87-3afdff2cdd32 service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:12.754682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4aea8f-d94c-483b-90b0-2a3b5365f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:12.755335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aea8f-d94c-483b-90b0-2a3b5365f675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.755631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aea8f-d94c-483b-90b0-2a3b5365f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.755942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aea8f-d94c-483b-90b0-2a3b5365f675 admin admin] PATH_INFO: `/v3/projects/6291d1ed20194d3db78dfdaa18177756/users/cf85d90eb8f5459f9de0f4d1f88904bc/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.826678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aea8f-d94c-483b-90b0-2a3b5365f675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6291d1ed20194d3db78dfdaa18177756, user_id=cf85d90eb8f5459f9de0f4d1f88904bc, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:12.830731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4aea8f-d94c-483b-90b0-2a3b5365f675 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:12.891644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 912/1826] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:12 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:12.896401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:12.917378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 915/1827] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:12 2022] PUT /identity/v3/projects/6291d1ed20194d3db78dfdaa18177756/users/cf85d90eb8f5459f9de0f4d1f88904bc/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:12.929993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf090-856e-4264-8ad0-58441313d349 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:12.930998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf090-856e-4264-8ad0-58441313d349 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:12.930998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bf090-856e-4264-8ad0-58441313d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:12.994442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-406bf090-856e-4264-8ad0-58441313d349 None None] MFA Rules not processed for user `cf85d90eb8f5459f9de0f4d1f88904bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:13.001269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-406bf090-856e-4264-8ad0-58441313d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:13.074109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70399880-e783-4220-8c4f-787edceda6aa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.175562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.176466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.176821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.177314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.178089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.180183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.203668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 916/1828] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:13.206600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf090-856e-4264-8ad0-58441313d349 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.219978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bf090-856e-4264-8ad0-58441313d349 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.226218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.226953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.227238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.227510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.228229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.231440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.286192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 913/1829] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:12 2022] POST /identity/v3/users => generated 300 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:13.287851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.301349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41734d90-18c2-4982-89d0-855979be46fc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.306242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.306911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.307195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.311486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.311486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.311486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.320614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 914/1830] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:13.321180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.322855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:13.335328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b462e2f-0042-48ba-b690-4022b212a232 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.340576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.341654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.341749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.341973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] PATH_INFO: `/v3/users/238d8fe440bb4ce5a179647cbf3ab5ca` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.343345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238d8fe440bb4ce5a179647cbf3ab5ca)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.346070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.384180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 917/1831] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:13 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:13.390456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.518055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238d8fe440bb4ce5a179647cbf3ab5ca'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:13.518589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e83b-9363-440c-9524-fbf20952c060 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.523323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc9659-e726-41a8-9400-ed2119eea3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.524879 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9659-e726-41a8-9400-ed2119eea3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.524879 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9659-e726-41a8-9400-ed2119eea3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.524879 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9659-e726-41a8-9400-ed2119eea3d5 admin admin] PATH_INFO: `/v3/projects/97d2dc6622914c158a4cbfc323ac0db3/users/89cd696ccfe949229e3c3e088dcab92b/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.542922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc9659-e726-41a8-9400-ed2119eea3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d2dc6622914c158a4cbfc323ac0db3, user_id=89cd696ccfe949229e3c3e088dcab92b, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.545769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc9659-e726-41a8-9400-ed2119eea3d5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.599810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238d8fe440bb4ce5a179647cbf3ab5ca'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:13.608476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238d8fe440bb4ce5a179647cbf3ab5ca'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:13.611016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238d8fe440bb4ce5a179647cbf3ab5ca'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:13.642705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238d8fe440bb4ce5a179647cbf3ab5ca'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:13.659551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 915/1832] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:13 2022] DELETE /identity/v3/users/238d8fe440bb4ce5a179647cbf3ab5ca => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:13.660739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.665099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 918/1833] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:13 2022] PUT /identity/v3/projects/97d2dc6622914c158a4cbfc323ac0db3/users/89cd696ccfe949229e3c3e088dcab92b/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:13.665805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:13.666585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.666785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.674644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.708041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:13.711072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:13.821796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02659-b904-4475-bc5b-a54c7136f1e0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.827367 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 919/1834] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:13.827531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fcde1-0d1c-491e-a2de-7b8a353a2de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.828223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcde1-0d1c-491e-a2de-7b8a353a2de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.828510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcde1-0d1c-491e-a2de-7b8a353a2de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.829405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fcde1-0d1c-491e-a2de-7b8a353a2de5 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.830120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fcde1-0d1c-491e-a2de-7b8a353a2de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.831222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.832327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fcde1-0d1c-491e-a2de-7b8a353a2de5 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.833475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:13.853898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba2adb-a13b-4721-8a71-34dd9604a06e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.860439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.861236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.861646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.862963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.862963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.865860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.895273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 920/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:13.896442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.898717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:13.944784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 916/1836] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:13 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:13.946255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed70c-d871-4237-98f8-84ed1a66bb88 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.946616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed70c-d871-4237-98f8-84ed1a66bb88 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.946902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed70c-d871-4237-98f8-84ed1a66bb88 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.948574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 917/1837] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:50:13.949866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed70c-d871-4237-98f8-84ed1a66bb88 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:13.978874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed70c-d871-4237-98f8-84ed1a66bb88 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:13.989883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:13.990850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:13.991116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:13.991651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] PATH_INFO: `/v3/projects/97d2dc6622914c158a4cbfc323ac0db3/users/89cd696ccfe949229e3c3e088dcab92b/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:13.993406 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d2dc6622914c158a4cbfc323ac0db3, user_id=89cd696ccfe949229e3c3e088dcab92b, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:13.996431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:13.997834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b11d7-c5cf-4489-ad42-4b5c9842cd37 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.002094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf095a7-1b68-474a-9cd7-c3e3d6771b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.002737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf095a7-1b68-474a-9cd7-c3e3d6771b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.003090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf095a7-1b68-474a-9cd7-c3e3d6771b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.003362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf095a7-1b68-474a-9cd7-c3e3d6771b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.008669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 918/1838] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:13 2022] PUT /identity/v3/projects/97d2dc6622914c158a4cbfc323ac0db3/users/89cd696ccfe949229e3c3e088dcab92b/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:14.009659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.015832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf095a7-1b68-474a-9cd7-c3e3d6771b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.025397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf095a7-1b68-474a-9cd7-c3e3d6771b3d service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.030987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 921/1839] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:14.032504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.032790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.033066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.055983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:14.065693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.084027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b80b30-5702-4eec-a676-51ec99888e2d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.093347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018157ef-b406-4052-a867-ce3c17e8a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.093347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018157ef-b406-4052-a867-ce3c17e8a921 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.093347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018157ef-b406-4052-a867-ce3c17e8a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.093347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018157ef-b406-4052-a867-ce3c17e8a921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.094530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018157ef-b406-4052-a867-ce3c17e8a921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.094530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018157ef-b406-4052-a867-ce3c17e8a921 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.107810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 919/1840] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:14.109370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.109659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.110509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.153182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] MFA Rules not processed for user `89cd696ccfe949229e3c3e088dcab92b`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:14.154486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.209179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 922/1841] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:50:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:14.216291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.228605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7674a9-76ad-4426-9dfe-8d304a4cf516 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.233412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.234421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.234708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.235515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] PATH_INFO: `/v3/projects/0a21a4b2ab4148feb805eae4f14fbb0c/users/5a124bf4e7cb441aaab229668e39336b/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.252898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 920/1842] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:14.253773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.256051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.258095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a21a4b2ab4148feb805eae4f14fbb0c, user_id=5a124bf4e7cb441aaab229668e39336b, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.261123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.277280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0549499-e307-4cc9-b06a-0a34a5457894 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.296190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.296956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.297957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.298320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.309976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.311744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.323533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 921/1843] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:14.324692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.326171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.349308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 923/1844] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:14 2022] PUT /identity/v3/projects/0a21a4b2ab4148feb805eae4f14fbb0c/users/5a124bf4e7cb441aaab229668e39336b/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:14.353472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.427805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415734a9-add9-4d99-9e21-bf8e63857a19 service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.477866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4bc7f-0f8f-4101-96e3-c1ba14709f72 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.486516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.487513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.493932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.493932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.494106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.494106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.494106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.494106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.494379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.494379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.507675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 924/1845] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:14.510901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.521412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf0dc-66ce-4da9-9c7b-5bca612009cf admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.526353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d090d6f-820e-4455-8b54-062fc85b6521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.527381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090d6f-820e-4455-8b54-062fc85b6521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.527789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090d6f-820e-4455-8b54-062fc85b6521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.528253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d090d6f-820e-4455-8b54-062fc85b6521 admin admin] PATH_INFO: `/v3/projects/0a21a4b2ab4148feb805eae4f14fbb0c/users/5a124bf4e7cb441aaab229668e39336b/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.530795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d090d6f-820e-4455-8b54-062fc85b6521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a21a4b2ab4148feb805eae4f14fbb0c, user_id=5a124bf4e7cb441aaab229668e39336b, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.534042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d090d6f-820e-4455-8b54-062fc85b6521 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.545250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 925/1846] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:14 2022] PUT /identity/v3/projects/0a21a4b2ab4148feb805eae4f14fbb0c/users/5a124bf4e7cb441aaab229668e39336b/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:14.558471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.558768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.559047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.566946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.566946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.573901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 922/1847] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:14.586786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] MFA Rules not processed for user `5a124bf4e7cb441aaab229668e39336b`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:14.588113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.641899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.643976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.666834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 926/1848] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:14.671963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0e84-2eef-4cfa-a6ed-49129e3638b7 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.684586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:14.684586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:14.754124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.755125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.755500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.755806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] PATH_INFO: `/v3/projects/42e6485b65d04243bcc669bcb2c88ce1` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.757978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e6485b65d04243bcc669bcb2c88ce1)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.760873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.809553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e852a-c684-4c51-a3cc-c7ad3d6753c4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:14.814033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:14.814705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:14.814966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:14.815236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:14.825825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:14.830685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:14.838366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 927/1849] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:14.903197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e6485b65d04243bcc669bcb2c88ce1', 'request_id': 'req-91c9e47f-3041-4c93-a675-a351a2a9cc1c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:14.916738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e6485b65d04243bcc669bcb2c88ce1', 'request_id': 'req-91c9e47f-3041-4c93-a675-a351a2a9cc1c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.006144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e6485b65d04243bcc669bcb2c88ce1', 'request_id': 'req-91c9e47f-3041-4c93-a675-a351a2a9cc1c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.021310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] The token cache is being invalidate because project 42e6485b65d04243bcc669bcb2c88ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:15.021592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.022253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.024250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 923/1850] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:14 2022] DELETE /identity/v3/projects/42e6485b65d04243bcc669bcb2c88ce1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:15.027892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:15.040116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba3c3e-55b0-40c0-897b-15b9ecae8fbc service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:15.099544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:15.100459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:15.100742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:15.101016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] PATH_INFO: `/v3/users/ca7880bf985d40cb875bd9b6b58514c9` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:15.102215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7880bf985d40cb875bd9b6b58514c9)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:15.104217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:15.303939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7880bf985d40cb875bd9b6b58514c9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.390642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7880bf985d40cb875bd9b6b58514c9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.403438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7880bf985d40cb875bd9b6b58514c9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.404131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7880bf985d40cb875bd9b6b58514c9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.404831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fbeff423-6c61-4845-900f-55b51d985079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7880bf985d40cb875bd9b6b58514c9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:15.431736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 928/1851] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:15 2022] DELETE /identity/v3/users/ca7880bf985d40cb875bd9b6b58514c9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:15.558607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:15.560107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:15.600531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e47f-3041-4c93-a675-a351a2a9cc1c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:15.727805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:15.733977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:15.734269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:15.734547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] PATH_INFO: `/v3/users/c4fe84a5f106475eba45452e6a3f52c9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:15.736603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fe84a5f106475eba45452e6a3f52c9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:15.738628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:15.951801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fe84a5f106475eba45452e6a3f52c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.095583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fe84a5f106475eba45452e6a3f52c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.105499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fe84a5f106475eba45452e6a3f52c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.106726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fe84a5f106475eba45452e6a3f52c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.121282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fe84a5f106475eba45452e6a3f52c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.129570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 924/1852] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:15 2022] DELETE /identity/v3/users/c4fe84a5f106475eba45452e6a3f52c9 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:16.138548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:16.139003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:16.139196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:16.191730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:16.191730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:16.204763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:16.211724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:16.368278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 929/1853] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:16.381775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4f7fc-9ddc-409b-a79d-e0bd256b75fc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:16.387418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:16.388615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:16.409082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:16.416297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:16.416297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:16.416297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] PATH_INFO: `/v3/users/b89e7986c4f54fca8d856a64253613cb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:16.416670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89e7986c4f54fca8d856a64253613cb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:16.420505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:16.514647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06b904-319a-4d13-b00c-0169d9673c33 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:16.521076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:16.521903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:16.522191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:16.522505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:16.536315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:16.538764 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:16.554390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 930/1854] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:16.662015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89e7986c4f54fca8d856a64253613cb'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.726611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89e7986c4f54fca8d856a64253613cb'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.736864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89e7986c4f54fca8d856a64253613cb'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.739401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89e7986c4f54fca8d856a64253613cb'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.765817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9d8eeeb1-fc3f-4e74-bb51-2cdedca0caa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89e7986c4f54fca8d856a64253613cb'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:16.767293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:16.769592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:16.778098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 925/1855] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:16 2022] DELETE /identity/v3/users/b89e7986c4f54fca8d856a64253613cb => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:16.780236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:16.780532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:16.780871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:16.790424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cc9c8-0d7a-460e-acdc-d897d8fd1c7c service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:16.825028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:16.825028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:16.960083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 926/1856] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:16.976548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:16.977573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:16.993206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:16.995477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:16.996163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:16.996901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] PATH_INFO: `/v3/projects/bee7315821eb41c38de278205bd2d210` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:16.999026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee7315821eb41c38de278205bd2d210)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:17.002672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:17.064733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a2c3f-d607-41a6-96f2-e56e49965185 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:17.070834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:17.072036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:17.072792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:17.073219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:17.114520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:17.116284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:17.127733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 927/1857] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:17.140484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee7315821eb41c38de278205bd2d210', 'request_id': 'req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.155672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee7315821eb41c38de278205bd2d210', 'request_id': 'req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.260994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee7315821eb41c38de278205bd2d210', 'request_id': 'req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.273809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] The token cache is being invalidate because project bee7315821eb41c38de278205bd2d210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:17.274094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.274826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.276536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 931/1858] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:16 2022] DELETE /identity/v3/projects/bee7315821eb41c38de278205bd2d210 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:17.280685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:17.282781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:17.299280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dfa4b-7738-4bef-a6a0-3b9bdc3ef53c service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:17.368228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:17.369289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:17.369682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:17.370116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] PATH_INFO: `/v3/users/2e765b4e988b4e6ab88dbc3d17e196dc` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:17.371598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e765b4e988b4e6ab88dbc3d17e196dc)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:17.373920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:17.463356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:17.464772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:17.483035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e27d6-5d75-4db6-a91e-b66f7ebbeacf admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:17.496949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:17.498042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:17.501286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:17.501766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] PATH_INFO: `/v3/projects/28d46cd5be5e43a383421d5d240aae66` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:17.503560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d46cd5be5e43a383421d5d240aae66)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:17.506058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:17.576334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e765b4e988b4e6ab88dbc3d17e196dc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.651710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e765b4e988b4e6ab88dbc3d17e196dc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.667653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e765b4e988b4e6ab88dbc3d17e196dc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.678466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e765b4e988b4e6ab88dbc3d17e196dc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.692236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d46cd5be5e43a383421d5d240aae66', 'request_id': 'req-8b819212-d5a8-4eda-89e7-34a122467e3c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.698538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d46cd5be5e43a383421d5d240aae66', 'request_id': 'req-8b819212-d5a8-4eda-89e7-34a122467e3c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.707593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e765b4e988b4e6ab88dbc3d17e196dc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.714893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 928/1859] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:17 2022] DELETE /identity/v3/users/2e765b4e988b4e6ab88dbc3d17e196dc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:17.760403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d46cd5be5e43a383421d5d240aae66', 'request_id': 'req-8b819212-d5a8-4eda-89e7-34a122467e3c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.781552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] The token cache is being invalidate because project 28d46cd5be5e43a383421d5d240aae66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:17.781848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.787326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:17.789822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:17.789929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:17.790006 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 932/1860] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:17 2022] DELETE /identity/v3/projects/28d46cd5be5e43a383421d5d240aae66 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:17.793698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:17.797854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:17.902968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b819212-d5a8-4eda-89e7-34a122467e3c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:17.946521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf01041-91ea-4904-842e-dc17909ed9de admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:17.964046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:17.964046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:17.964046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:17.964046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] PATH_INFO: `/v3/projects/c77d0161a1a046bb94c66c2d2fdd9b25` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:17.964449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77d0161a1a046bb94c66c2d2fdd9b25)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:17.964449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:18.029887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:18.030856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:18.031139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:18.031411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] PATH_INFO: `/v3/users/d1365aac543d46d89060017976283b56` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:18.032955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1365aac543d46d89060017976283b56)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:18.034917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:18.128718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77d0161a1a046bb94c66c2d2fdd9b25', 'request_id': 'req-88c33ba6-ff78-4c53-878e-5804978889b8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.138448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77d0161a1a046bb94c66c2d2fdd9b25', 'request_id': 'req-88c33ba6-ff78-4c53-878e-5804978889b8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.239809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77d0161a1a046bb94c66c2d2fdd9b25', 'request_id': 'req-88c33ba6-ff78-4c53-878e-5804978889b8'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.260554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] The token cache is being invalidate because project c77d0161a1a046bb94c66c2d2fdd9b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:18.261308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.264156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.270022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 929/1861] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:17 2022] DELETE /identity/v3/projects/c77d0161a1a046bb94c66c2d2fdd9b25 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:18.276194 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:18.277931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:18.319274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1365aac543d46d89060017976283b56'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.411639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1365aac543d46d89060017976283b56'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.421034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1365aac543d46d89060017976283b56'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.421999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1365aac543d46d89060017976283b56'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.423311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1365aac543d46d89060017976283b56'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.453428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c33ba6-ff78-4c53-878e-5804978889b8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:18.458806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:18.459828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:18.460109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:18.460381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] PATH_INFO: `/v3/users/89cd696ccfe949229e3c3e088dcab92b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:18.461681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cd696ccfe949229e3c3e088dcab92b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:18.464251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:18.479256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 933/1862] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:17 2022] DELETE /identity/v3/users/d1365aac543d46d89060017976283b56 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:18.558008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:18.560007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:18.687103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f40dbc-27be-4f13-af4b-2ae7b6ef96fe admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:18.694995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:18.696007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:18.697166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:18.697166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] PATH_INFO: `/v3/projects/25ee3cb4498548c99b1d6128c3f196d9` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:18.698845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ee3cb4498548c99b1d6128c3f196d9)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:18.701698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:18.805426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cd696ccfe949229e3c3e088dcab92b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.843237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ee3cb4498548c99b1d6128c3f196d9', 'request_id': 'req-2bbf8c94-f224-49d0-a5f6-92929072bd99'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.850407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ee3cb4498548c99b1d6128c3f196d9', 'request_id': 'req-2bbf8c94-f224-49d0-a5f6-92929072bd99'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.921072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cd696ccfe949229e3c3e088dcab92b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.933564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cd696ccfe949229e3c3e088dcab92b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.934454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cd696ccfe949229e3c3e088dcab92b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.954362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cd696ccfe949229e3c3e088dcab92b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:18.960697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 930/1863] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:18 2022] DELETE /identity/v3/users/89cd696ccfe949229e3c3e088dcab92b => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:18.963675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:18.963675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:18.986526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ee3cb4498548c99b1d6128c3f196d9', 'request_id': 'req-2bbf8c94-f224-49d0-a5f6-92929072bd99'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.005016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] The token cache is being invalidate because project 25ee3cb4498548c99b1d6128c3f196d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:19.007739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.008345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2bbf8c94-f224-49d0-a5f6-92929072bd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.010224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 934/1864] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:18 2022] DELETE /identity/v3/projects/25ee3cb4498548c99b1d6128c3f196d9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:19.016179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98e86-df8f-4f11-8896-ff8841b29331 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.017272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98e86-df8f-4f11-8896-ff8841b29331 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.017630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98e86-df8f-4f11-8896-ff8841b29331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.036150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e5f98e86-df8f-4f11-8896-ff8841b29331 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:19.037344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e5f98e86-df8f-4f11-8896-ff8841b29331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.038720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b4eb9-fbc9-4720-a29a-70cb26907d52 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.043454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.044379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.044664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.044945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] PATH_INFO: `/v3/users/cf85d90eb8f5459f9de0f4d1f88904bc` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.051595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 935/1865] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:19.051781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf85d90eb8f5459f9de0f4d1f88904bc)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.051781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.053692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.053978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.054254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.081150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:19.085042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.095784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 936/1866] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:19.096698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:19.097961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.110313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafab5e-cdb3-4223-add3-4d80edc44add None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.115279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.117443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.117443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.117443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] PATH_INFO: `/v3/projects/7828be0741be4d34a1be2cf0fa5ffac3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.118220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7828be0741be4d34a1be2cf0fa5ffac3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.121959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.236960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf85d90eb8f5459f9de0f4d1f88904bc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.254409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7828be0741be4d34a1be2cf0fa5ffac3', 'request_id': 'req-1b209a43-ea65-45b2-8658-51894071cfdd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.259827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7828be0741be4d34a1be2cf0fa5ffac3', 'request_id': 'req-1b209a43-ea65-45b2-8658-51894071cfdd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.319957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf85d90eb8f5459f9de0f4d1f88904bc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.328440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf85d90eb8f5459f9de0f4d1f88904bc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.330297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf85d90eb8f5459f9de0f4d1f88904bc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.345458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf85d90eb8f5459f9de0f4d1f88904bc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.354682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 931/1867] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:18 2022] DELETE /identity/v3/users/cf85d90eb8f5459f9de0f4d1f88904bc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:19.355774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:19.357367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.411267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7828be0741be4d34a1be2cf0fa5ffac3', 'request_id': 'req-1b209a43-ea65-45b2-8658-51894071cfdd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.424282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] The token cache is being invalidate because project 7828be0741be4d34a1be2cf0fa5ffac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:19.424785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.425570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-1b209a43-ea65-45b2-8658-51894071cfdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.427280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 937/1868] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:19 2022] DELETE /identity/v3/projects/7828be0741be4d34a1be2cf0fa5ffac3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:19.429464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e634-e914-4ab6-9507-b1b82972792d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.429971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e634-e914-4ab6-9507-b1b82972792d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.430243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e634-e914-4ab6-9507-b1b82972792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.447319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc14c7-37d1-49bc-8788-9a550526e97c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.449191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0ae9e634-e914-4ab6-9507-b1b82972792d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:19.456278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0ae9e634-e914-4ab6-9507-b1b82972792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.456423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.456423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.456423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.456423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.456743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:19.456743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.456743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.460589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 938/1869] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:19.462156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.462593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.463115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.470540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 932/1870] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:19.472351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:19.476357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.491738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:19.493723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.505665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 939/1871] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:19.507203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:19.508929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.521909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2ed74-3dd3-4293-92ed-e9c3719c0f00 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.528151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.529290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.532126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.532126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.532126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.534275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.629651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 940/1872] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:19.630962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:19.634856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.640763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976174-27fc-4da5-9343-e78113f2bbfa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.713636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65a81-9bea-4be4-9e93-b36c7ca2ab65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.714740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65a81-9bea-4be4-9e93-b36c7ca2ab65 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.715908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65a81-9bea-4be4-9e93-b36c7ca2ab65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.715908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65a81-9bea-4be4-9e93-b36c7ca2ab65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.732700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15522bc-5cb1-4bdd-b7aa-d97f88a1dffa admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.738493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.739726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.740275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.745316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] PATH_INFO: `/v3/projects/97d2dc6622914c158a4cbfc323ac0db3` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.745316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d2dc6622914c158a4cbfc323ac0db3)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.745316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.788361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa65a81-9bea-4be4-9e93-b36c7ca2ab65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.790199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa65a81-9bea-4be4-9e93-b36c7ca2ab65 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.800684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 933/1873] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:19.802083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.802372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.802646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.828825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:19.830137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:19.839251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 934/1874] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:19.839996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:19.869046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5d980-1e1e-4eb7-904e-fe38d03fd850 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:19.877459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d2dc6622914c158a4cbfc323ac0db3', 'request_id': 'req-19305776-f46d-4030-9fd8-9e7e53df2d2d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.887834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d2dc6622914c158a4cbfc323ac0db3', 'request_id': 'req-19305776-f46d-4030-9fd8-9e7e53df2d2d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:19.948624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:19.949297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:19.949582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:19.949858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:19.950607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:19.952600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:19.992712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d2dc6622914c158a4cbfc323ac0db3', 'request_id': 'req-19305776-f46d-4030-9fd8-9e7e53df2d2d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.005064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] The token cache is being invalidate because project 97d2dc6622914c158a4cbfc323ac0db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:20.005254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.005925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.007698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 941/1875] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:19 2022] DELETE /identity/v3/projects/97d2dc6622914c158a4cbfc323ac0db3 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:20.008377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.012420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.025950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19305776-f46d-4030-9fd8-9e7e53df2d2d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.030856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.031520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.031867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.032666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.033407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:20.033718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.035576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb9639-f0ad-4da2-aff7-8891c6d31c45 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.049710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 942/1876] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:20.051184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.051478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.051786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.085461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 935/1877] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:19 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:20.086308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.100524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:20.101581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.106999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb42f-12ff-423e-8f25-9cc6703a59a2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.121531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.122302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.122590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.123885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.124916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.128091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.134560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 943/1878] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:20.134560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.140930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.152399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8626b-e1b7-45bb-affa-91da1398f6fa None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.161663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755daabb-bcc8-4f4a-b6e3-21680aa99e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.163332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daabb-bcc8-4f4a-b6e3-21680aa99e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.163332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daabb-bcc8-4f4a-b6e3-21680aa99e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.163332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755daabb-bcc8-4f4a-b6e3-21680aa99e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.163956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755daabb-bcc8-4f4a-b6e3-21680aa99e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.165917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755daabb-bcc8-4f4a-b6e3-21680aa99e1c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.182458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 944/1879] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:20.182458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.182458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.182725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.204895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:20.206128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.218110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 945/1880] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:20.218110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.229597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eca1e-2986-49ff-980f-9455dd1a3f17 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.236256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 936/1881] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:20.237112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.240707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.241007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.241400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.242337 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.242568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.244351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.258831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 946/1882] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:20.258831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.271892 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1177a-9039-42a2-b742-8e12651611aa admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.342430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82302c-40ce-4657-9776-def8eaf8b85a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.352256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.353553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.354812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.355381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.355838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.362340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:20.362340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.362535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.362535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.362535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.362535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.362790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.363204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.379758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 937/1883] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:20.380737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.390643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea2a8e-7f15-48cd-8926-49dc8739797b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.395632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.396550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.396877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.397151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] PATH_INFO: `/v3/projects/1db5f635bf7343cdbf9baac6bbb9951c/users/51ff5d681f4745f5abb16d7a895cd613/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.415725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db5f635bf7343cdbf9baac6bbb9951c, user_id=51ff5d681f4745f5abb16d7a895cd613, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.418543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.464390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 947/1884] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:20.465638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.481427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88bd4c-8d18-4ce3-b104-ea03b76728f0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.487725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.488425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.488704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.488978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.490456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.500318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.527367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 938/1885] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:20 2022] PUT /identity/v3/projects/1db5f635bf7343cdbf9baac6bbb9951c/users/51ff5d681f4745f5abb16d7a895cd613/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:20.528315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.530040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.627034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c14b-b6ad-4739-862a-bbe0a195718f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.632626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.634774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.634774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.634774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] PATH_INFO: `/v3/projects/6291d1ed20194d3db78dfdaa18177756` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.636804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6291d1ed20194d3db78dfdaa18177756)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.638050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.641521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 948/1886] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:20.642447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.722943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0edd-b19a-4834-bdde-1504cd1082bf admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.727795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ce54-29b1-4fec-b631-d06ac7d728d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.728451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ce54-29b1-4fec-b631-d06ac7d728d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.728757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ce54-29b1-4fec-b631-d06ac7d728d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.729026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ce54-29b1-4fec-b631-d06ac7d728d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.729786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ce54-29b1-4fec-b631-d06ac7d728d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.731379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ce54-29b1-4fec-b631-d06ac7d728d3 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.742947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 949/1887] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:20.744957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.745409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.745690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.772447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] MFA Rules not processed for user `51ff5d681f4745f5abb16d7a895cd613`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:20.773680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.818587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6291d1ed20194d3db78dfdaa18177756', 'request_id': 'req-1054ef06-5588-4743-b1c5-039cbc5fc6e3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.825596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6291d1ed20194d3db78dfdaa18177756', 'request_id': 'req-1054ef06-5588-4743-b1c5-039cbc5fc6e3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.867959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 950/1888] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:20.868992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.879056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae414dc4-34b0-4aef-94fd-7fbb475cdc3c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.919727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6291d1ed20194d3db78dfdaa18177756', 'request_id': 'req-1054ef06-5588-4743-b1c5-039cbc5fc6e3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.934507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] The token cache is being invalidate because project 6291d1ed20194d3db78dfdaa18177756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:20.934791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.935859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:20.937434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 939/1889] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:20 2022] DELETE /identity/v3/projects/6291d1ed20194d3db78dfdaa18177756 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:20.941663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.941663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.942907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.943814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.944103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.944381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.945087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.947052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.952911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054ef06-5588-4743-b1c5-039cbc5fc6e3 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.962363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:20.963071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:20.963351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:20.963698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:20.964721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:20.970197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:20.978800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 940/1890] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:20.979652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:20.981287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:20.994319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52da1-f8c2-48a1-b407-71408fd7bbcb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:20.999367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.000067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.000343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.000667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.001362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.003267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.038469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 951/1891] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:21.038469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.038469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.049023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e489b43-3826-4c6e-81a5-f63c40796468 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.053652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.054509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.054783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.055063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] PATH_INFO: `/v3/users/5a124bf4e7cb441aaab229668e39336b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.056284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a124bf4e7cb441aaab229668e39336b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.058225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.140926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 941/1892] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:20 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:21.140926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.200469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bcda2-ba8f-4d97-9461-a81d80a54791 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.205689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.206582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.206862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.207131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] PATH_INFO: `/v3/projects/a450b5f378d046cca901c08a36f5fb68/users/86a9b9207f1b4519a140fb0cd33ef7b6/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.223124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a450b5f378d046cca901c08a36f5fb68, user_id=86a9b9207f1b4519a140fb0cd33ef7b6, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.227783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.268637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a124bf4e7cb441aaab229668e39336b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:21.330360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 942/1893] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:21 2022] PUT /identity/v3/projects/a450b5f378d046cca901c08a36f5fb68/users/86a9b9207f1b4519a140fb0cd33ef7b6/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:21.331125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.332720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.380702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a124bf4e7cb441aaab229668e39336b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:21.387936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a124bf4e7cb441aaab229668e39336b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:21.388562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a124bf4e7cb441aaab229668e39336b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:21.389268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a124bf4e7cb441aaab229668e39336b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:21.394301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de79eb-a56a-49d8-8e50-5ebe5e14aa8a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.399105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b85f1-0788-4d89-8fff-3ec9c00c8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.399788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b85f1-0788-4d89-8fff-3ec9c00c8da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.400071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b85f1-0788-4d89-8fff-3ec9c00c8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.400341 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b85f1-0788-4d89-8fff-3ec9c00c8da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.401061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b85f1-0788-4d89-8fff-3ec9c00c8da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.402649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b85f1-0788-4d89-8fff-3ec9c00c8da3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.407501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 952/1894] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:21 2022] DELETE /identity/v3/users/5a124bf4e7cb441aaab229668e39336b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:21.408421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.414844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.415447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 943/1895] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:21.415447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.415447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.415698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.444156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] MFA Rules not processed for user `86a9b9207f1b4519a140fb0cd33ef7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:21.445374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.488259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd144a-6c1c-4821-97fe-bd39894b387d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.493417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.494099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.494827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.494827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.495326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.497329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.513075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 944/1896] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:21.514107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.515390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.530422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f72df-b5f0-463b-8422-12f040b5fede None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.535107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.536111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.536391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.536662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.537464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.539120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.550112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 945/1897] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:21.551102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.552846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.565941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464d156-18a7-4a14-9ec4-9d05e71d3bc7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.570825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.571585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.571929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.572204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.572886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.576102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.654087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 953/1898] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:21 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:21.654087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.664646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230135c5-c135-439a-9159-61ed0460bf8b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.673041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.682021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.682302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.682578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] PATH_INFO: `/v3/projects/97a6db1ee2c54c65ab10e33619ccb8f9/users/043dcb4829354ab1b611d6a8987fa60b/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.685509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 946/1899] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:21 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:21.686417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.708803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a6db1ee2c54c65ab10e33619ccb8f9, user_id=043dcb4829354ab1b611d6a8987fa60b, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.712403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.782813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 954/1900] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:21 2022] PUT /identity/v3/projects/97a6db1ee2c54c65ab10e33619ccb8f9/users/043dcb4829354ab1b611d6a8987fa60b/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:21.784137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.799639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494ee75-2ad7-4928-a192-064699f37e51 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.870452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb30e66-26f8-4652-94fd-d2f131fe8f5e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:21.872164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2747cce-828e-48fa-b592-82dbeded1ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.872882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747cce-828e-48fa-b592-82dbeded1ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.873090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:21.873369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747cce-828e-48fa-b592-82dbeded1ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.873585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.873688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747cce-828e-48fa-b592-82dbeded1ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.873863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.874134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.874374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747cce-828e-48fa-b592-82dbeded1ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.874820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:21.876066 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747cce-828e-48fa-b592-82dbeded1ec4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.877006 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:21.887504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 947/1901] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:21.888767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:21.889058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:21.889336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:21.916825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] MFA Rules not processed for user `043dcb4829354ab1b611d6a8987fa60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:21.918081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:21.993174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 955/1902] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:21 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:21.994100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:21.998473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 948/1903] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:21.998473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.011359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc771-156c-4f41-83aa-de64ae7220f8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.011755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433c74a-49a4-4a2e-8945-482e5ece5bcd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.016873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.017152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.017777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.017883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.018061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.018155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.018328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] PATH_INFO: `/v3/projects/7ef70a25956f42b29c2c2c4d3a789e41/users/86fa654e08ce4b0f968d268d132339f4/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.018431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.019148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.020824 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.032485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 949/1904] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:22.033491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.036241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef70a25956f42b29c2c2c4d3a789e41, user_id=86fa654e08ce4b0f968d268d132339f4, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.039324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.054780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd1ca-0046-45c8-990e-5d858bd9228a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.059699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.060363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.060649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.060923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.061619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.064147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.096847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 956/1905] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:21 2022] PUT /identity/v3/projects/7ef70a25956f42b29c2c2c4d3a789e41/users/86fa654e08ce4b0f968d268d132339f4/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:22.098119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.099960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.137862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 950/1906] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:22.138778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.164080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1349276-9ade-4b02-8a93-4bad8077eca9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.204396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809ef5c-0e1c-46ef-b49e-3f04ed6b31f2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.209046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.209961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.210244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.210518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] PATH_INFO: `/v3/projects/5079c4175cc6417b86098d6c32f97c5b/users/a6600bf76c224ddfae870fa4864c25cc/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.223988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.224843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.224982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5079c4175cc6417b86098d6c32f97c5b, user_id=a6600bf76c224ddfae870fa4864c25cc, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.225123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.225398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] PATH_INFO: `/v3/projects/0a21a4b2ab4148feb805eae4f14fbb0c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.226571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a21a4b2ab4148feb805eae4f14fbb0c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.227694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.228498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.330155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 951/1907] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:22 2022] PUT /identity/v3/projects/5079c4175cc6417b86098d6c32f97c5b/users/a6600bf76c224ddfae870fa4864c25cc/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:22.331002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.357823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a21a4b2ab4148feb805eae4f14fbb0c', 'request_id': 'req-95467aae-d97f-4625-a243-142244bdd35d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:22.367679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a21a4b2ab4148feb805eae4f14fbb0c', 'request_id': 'req-95467aae-d97f-4625-a243-142244bdd35d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:22.415564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996eed3-bba1-4c40-8f1f-032693a269cc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.461941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a21a4b2ab4148feb805eae4f14fbb0c', 'request_id': 'req-95467aae-d97f-4625-a243-142244bdd35d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:22.473663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] The token cache is being invalidate because project 0a21a4b2ab4148feb805eae4f14fbb0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:22.473948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:22.474290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.474575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:22.474960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.475244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.475521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.479469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 957/1908] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:22 2022] DELETE /identity/v3/projects/0a21a4b2ab4148feb805eae4f14fbb0c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:22.479593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.479830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.479906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.480020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.488684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 952/1909] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:22.489382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.491101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.491956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95467aae-d97f-4625-a243-142244bdd35d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.496731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534ec7-8275-40d2-b6a2-82acbb357cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.497407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534ec7-8275-40d2-b6a2-82acbb357cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.497700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534ec7-8275-40d2-b6a2-82acbb357cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.497969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534ec7-8275-40d2-b6a2-82acbb357cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.498634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc534ec7-8275-40d2-b6a2-82acbb357cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.501546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc534ec7-8275-40d2-b6a2-82acbb357cc4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.503909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d17f-4a7d-403f-a61d-8002eea97447 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.508506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8dab08-92ec-4e91-b047-1e58a1cbb90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.510731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dab08-92ec-4e91-b047-1e58a1cbb90e admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.510731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dab08-92ec-4e91-b047-1e58a1cbb90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.510731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dab08-92ec-4e91-b047-1e58a1cbb90e admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.510731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dab08-92ec-4e91-b047-1e58a1cbb90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.512041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8dab08-92ec-4e91-b047-1e58a1cbb90e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.522192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 953/1910] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:22.523402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.523712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.523989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.541573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:22.542748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.551202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 954/1911] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:22.552594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.553934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.567287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf467e39-e108-4e4c-bde3-2199a709a318 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.571946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.572839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.573120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.573395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] PATH_INFO: `/v3/projects/7ef70a25956f42b29c2c2c4d3a789e41/users/86fa654e08ce4b0f968d268d132339f4/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.575367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef70a25956f42b29c2c2c4d3a789e41, user_id=86fa654e08ce4b0f968d268d132339f4, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.578008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.587942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 955/1912] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:22 2022] PUT /identity/v3/projects/7ef70a25956f42b29c2c2c4d3a789e41/users/86fa654e08ce4b0f968d268d132339f4/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:22.588685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.630179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 958/1913] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:22.630179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a7ca-4b58-47de-bb1f-fd58f62c6fe3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.630179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a7ca-4b58-47de-bb1f-fd58f62c6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.630179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a7ca-4b58-47de-bb1f-fd58f62c6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.647723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-84c6a7ca-4b58-47de-bb1f-fd58f62c6fe3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:22.648916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-84c6a7ca-4b58-47de-bb1f-fd58f62c6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.650448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a320b4-2052-45e5-9562-1bf09861ddc6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.655693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.656746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.657055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.657332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] PATH_INFO: `/v3/projects/5079c4175cc6417b86098d6c32f97c5b/users/a6600bf76c224ddfae870fa4864c25cc/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.658273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 959/1914] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:22.659539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f228e-2221-4e5f-a21b-3ecfcf6082b4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.659855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f228e-2221-4e5f-a21b-3ecfcf6082b4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.660140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f228e-2221-4e5f-a21b-3ecfcf6082b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.662715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5079c4175cc6417b86098d6c32f97c5b, user_id=a6600bf76c224ddfae870fa4864c25cc, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.665389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.676855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 956/1915] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:22 2022] PUT /identity/v3/projects/5079c4175cc6417b86098d6c32f97c5b/users/a6600bf76c224ddfae870fa4864c25cc/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:22.677627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.686685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-db7f228e-2221-4e5f-a21b-3ecfcf6082b4 None None] MFA Rules not processed for user `86fa654e08ce4b0f968d268d132339f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:22.687933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-db7f228e-2221-4e5f-a21b-3ecfcf6082b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.739563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8249751-72f7-4da4-be88-3cff229542dd admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.744184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.744844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.745124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.745402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.746133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.747788 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.760455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 957/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:22.760627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 960/1917] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:22.760722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.760829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.760829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.760829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.770765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faa85f-57eb-47f4-884b-9ed7604538ee admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.775448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.776137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.776414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.776682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.777433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:22.777786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.779362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.789117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] MFA Rules not processed for user `a6600bf76c224ddfae870fa4864c25cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:22.791018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.796272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 958/1918] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:22.796272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.807866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89c0a-a0ac-482e-bac8-f6a1e59f66c0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:22.814283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:22.815184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:22.815469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:22.815779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] PATH_INFO: `/v3/projects/7c08567f2f3a4fb38dd0cfe889060ca7/users/56d3eb02585e46eab783b5b4c9461f62/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:22.839749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c08567f2f3a4fb38dd0cfe889060ca7, user_id=56d3eb02585e46eab783b5b4c9461f62, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:22.842909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:22.878797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 961/1919] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:22.883591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.884932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:22.941933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 959/1920] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:22 2022] PUT /identity/v3/projects/7c08567f2f3a4fb38dd0cfe889060ca7/users/56d3eb02585e46eab783b5b4c9461f62/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:22.941933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:22.955117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fa0d9-17e8-4ecb-883b-242f0d9bbda2 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.017985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2199e49-713b-4fa5-b1ab-ffd4ebc0af33 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.018637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.019349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.019660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.019942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.022160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:23.023575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.024540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.025031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.025491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.026431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.029163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.086177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.087958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.108609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 962/1921] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:23.109462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.111441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:23.122483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5298-9755-4a93-bcf5-16219d52b65e service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.127028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.127705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.130881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.130881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.131042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 960/1922] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:22 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:23.131704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.215526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.216333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fd82c-f093-4961-a629-4999c655c275 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.217553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.222561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.223279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.223713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.224097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.224734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.226497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.229854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 963/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:23.230678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.241654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 961/1924] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:23.245891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541ba9-c01d-4df0-ac24-19b492aeec74 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.246163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.254248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.254896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.255184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.255503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.256876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.259094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.273531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a0de1-d54f-45a5-a142-07e817011fc9 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.283781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29a638-af3e-47dd-b8ec-b64f3ae666d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.284736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a638-af3e-47dd-b8ec-b64f3ae666d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.285680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a638-af3e-47dd-b8ec-b64f3ae666d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.285680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29a638-af3e-47dd-b8ec-b64f3ae666d9 admin admin] PATH_INFO: `/v3/projects/7c08567f2f3a4fb38dd0cfe889060ca7/users/56d3eb02585e46eab783b5b4c9461f62/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.288081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a638-af3e-47dd-b8ec-b64f3ae666d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c08567f2f3a4fb38dd0cfe889060ca7, user_id=56d3eb02585e46eab783b5b4c9461f62, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.291373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a29a638-af3e-47dd-b8ec-b64f3ae666d9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.311653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 962/1925] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:23 2022] PUT /identity/v3/projects/7c08567f2f3a4fb38dd0cfe889060ca7/users/56d3eb02585e46eab783b5b4c9461f62/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:23.317412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.317712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.318132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.351868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] MFA Rules not processed for user `56d3eb02585e46eab783b5b4c9461f62`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:23.353093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:23.367546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 964/1926] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:23 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:23.371734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.385485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b774be-c88f-44ca-a8ea-de68be8cff1a admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.453324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 963/1927] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:23.457556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.458212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.458490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.458761 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.459486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.461174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.471721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 965/1928] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:23.476793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.487582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335a585-4e34-430f-ab00-f7c0b459382f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.492162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2baca8-267f-41ba-b64c-b0dfd9dc11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.492804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2baca8-267f-41ba-b64c-b0dfd9dc11cd admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.493081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2baca8-267f-41ba-b64c-b0dfd9dc11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.494498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2baca8-267f-41ba-b64c-b0dfd9dc11cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.494498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2baca8-267f-41ba-b64c-b0dfd9dc11cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.495705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2baca8-267f-41ba-b64c-b0dfd9dc11cd admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.505348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 964/1929] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:23.509522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.519390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de812b-54d5-4557-b6bb-4fd4bdce7a6f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.524275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.525142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.525420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.525687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] PATH_INFO: `/v3/projects/ef25f5c8cc494b72a911e506ce6aca22/users/c29a9f9a0b52410ba5ac2a44be4caf6a/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.548614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef25f5c8cc494b72a911e506ce6aca22, user_id=c29a9f9a0b52410ba5ac2a44be4caf6a, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.551328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.647342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 966/1930] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:23 2022] PUT /identity/v3/projects/ef25f5c8cc494b72a911e506ce6aca22/users/c29a9f9a0b52410ba5ac2a44be4caf6a/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:23.661318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.661685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.662361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.680308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.704102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] MFA Rules not processed for user `c29a9f9a0b52410ba5ac2a44be4caf6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:23.705592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:23.779178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b34e-e9dd-4a49-999c-9910abc1de40 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.784058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 965/1931] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:23.785094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.788808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.790386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.791716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.791716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] PATH_INFO: `/v3/users/86a9b9207f1b4519a140fb0cd33ef7b6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.793433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a9b9207f1b4519a140fb0cd33ef7b6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.795331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.858800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85699ea0-890c-4f8e-b4a8-3f52c3a12ad5 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.862843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.863518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.863960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.864392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.928743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.930273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:23.943446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 966/1932] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:23.944233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:23.965488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f8a38-3db7-4e6e-8c5c-92f284380593 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:23.988368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:23.988368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:23.988368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:23.988368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:23.988673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:23.990493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.002627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a9b9207f1b4519a140fb0cd33ef7b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.068381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a9b9207f1b4519a140fb0cd33ef7b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.076987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 967/1933] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:23 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:24.081377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.081651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a9b9207f1b4519a140fb0cd33ef7b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.082431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a9b9207f1b4519a140fb0cd33ef7b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.083312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d6ae3394-06a6-4b5b-abba-0b9b3280da8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a9b9207f1b4519a140fb0cd33ef7b6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.085098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.128251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 967/1934] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:23 2022] DELETE /identity/v3/users/86a9b9207f1b4519a140fb0cd33ef7b6 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:24.149280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.149633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.152787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.197332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:24.198776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.225529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0590a-12a1-41e2-b3e4-f0793146d9d1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.311187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.319851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.319851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.319851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.319851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.319851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.343712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 968/1935] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:24.369378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.371931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.428990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 968/1936] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:24 2022] POST /identity/v3/users => generated 294 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:24.436956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.451920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc7301-8a99-4c44-ad55-cc78466c0fba admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.459216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.462691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.462691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.462691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.462691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.464125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.468727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e541ba-2eba-4ca7-8a00-41297d43cb46 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.473339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.474237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.474695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.475143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.475992 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 969/1937] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:24.479581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.489867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.490848 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550aa9f-344c-42df-96aa-ac947da77b25 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.491640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.496951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.497851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.498301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.498768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.499688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.502542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.504515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 969/1938] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:24.517577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 970/1939] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:24.521838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.532287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209ee78-6ec7-4301-a110-dc55f8052fd9 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.538528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b233f0d-391b-48b5-ae7a-6dd446472027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.539569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233f0d-391b-48b5-ae7a-6dd446472027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.539729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233f0d-391b-48b5-ae7a-6dd446472027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.539999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b233f0d-391b-48b5-ae7a-6dd446472027 admin admin] PATH_INFO: `/v3/projects/56258a6d0d39454ba7de61ee54089508/users/8fcc72d867cc42a69e826dcd9f2aa680/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.558199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b233f0d-391b-48b5-ae7a-6dd446472027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56258a6d0d39454ba7de61ee54089508, user_id=8fcc72d867cc42a69e826dcd9f2aa680, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.560992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b233f0d-391b-48b5-ae7a-6dd446472027 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.605314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.607267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.623151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146a948-cd62-45f3-93bc-cfc223a6bf62 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.629644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.630769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.631178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.631532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] PATH_INFO: `/v3/users/043dcb4829354ab1b611d6a8987fa60b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.633530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043dcb4829354ab1b611d6a8987fa60b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.635841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.646571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 970/1940] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:24 2022] PUT /identity/v3/projects/56258a6d0d39454ba7de61ee54089508/users/8fcc72d867cc42a69e826dcd9f2aa680/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:24.652491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.652783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.653062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.691342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] MFA Rules not processed for user `8fcc72d867cc42a69e826dcd9f2aa680`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:24.692826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.773096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 971/1941] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:24.777408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.822051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043dcb4829354ab1b611d6a8987fa60b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.841358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b82562-a680-44e3-a946-a49c09ec5c3a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:24.846146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:24.846807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.847108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.847435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.848163 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:24.852041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:24.863058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043dcb4829354ab1b611d6a8987fa60b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.871653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043dcb4829354ab1b611d6a8987fa60b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.872347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043dcb4829354ab1b611d6a8987fa60b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.884300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0dcb5825-b004-47b9-bae1-f6e2d62d2541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043dcb4829354ab1b611d6a8987fa60b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:24.891024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 971/1942] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:24 2022] DELETE /identity/v3/users/043dcb4829354ab1b611d6a8987fa60b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:24.895253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:24.895547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:24.895860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:24.915434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:24.915434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.941999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 972/1943] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:24 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:24.945763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:24.947925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:24.996081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 972/1944] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:25.006017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.008903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:25.084362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76928b44-1ff1-48a9-8022-5b3b1420f10a admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.093729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9ed7a-8c35-46ea-ad63-658c2ce4fc22 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.096614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.098204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.098969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.099647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.102213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.106034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.196806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.196806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.196806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.196806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.216183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 973/1945] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:24 2022] POST /identity/v3/users => generated 298 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:25.218297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.224886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.226745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.242042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 973/1946] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:25.247725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e420e-6b9b-499f-9d36-376eb5821364 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.253182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.254243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.254603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.254979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.255818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.257515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.271758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 974/1947] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:25.288001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.298771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d40eee-173b-413d-9fc6-974a4b825673 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.310956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.312036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.312162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.312855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] PATH_INFO: `/v3/projects/040d22f78f8146db8a4cbca7a4070319/users/02a2e547ec144ef9a66c6d6e042a558e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.346465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=040d22f78f8146db8a4cbca7a4070319, user_id=02a2e547ec144ef9a66c6d6e042a558e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.346465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.417265 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.418970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:25.430836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 974/1948] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:25 2022] PUT /identity/v3/projects/040d22f78f8146db8a4cbca7a4070319/users/02a2e547ec144ef9a66c6d6e042a558e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:25.431853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.441509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c519-7933-43ef-9617-d2a22170aecd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.566221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.566926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b2b07-aa9b-449e-9699-677fc061be4c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.567168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.567529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.568001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] PATH_INFO: `/v3/projects/a450b5f378d046cca901c08a36f5fb68` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.569241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a450b5f378d046cca901c08a36f5fb68)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.571258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.572034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.572797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.573186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.573434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.574164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.575823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.586882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 975/1949] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:25.591011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.601753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f0b6a-a0ca-470c-813c-6613eb2a41ad admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.608895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662c699-e0ae-4362-930f-f788fdf4f8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.614225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c699-e0ae-4362-930f-f788fdf4f8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.614225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c699-e0ae-4362-930f-f788fdf4f8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.614225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662c699-e0ae-4362-930f-f788fdf4f8db admin admin] PATH_INFO: `/v3/projects/040d22f78f8146db8a4cbca7a4070319/users/02a2e547ec144ef9a66c6d6e042a558e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.614903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c699-e0ae-4362-930f-f788fdf4f8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=040d22f78f8146db8a4cbca7a4070319, user_id=02a2e547ec144ef9a66c6d6e042a558e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.617624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662c699-e0ae-4362-930f-f788fdf4f8db admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:25.629774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 976/1950] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:25 2022] PUT /identity/v3/projects/040d22f78f8146db8a4cbca7a4070319/users/02a2e547ec144ef9a66c6d6e042a558e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:25.645403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.645403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.645403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.669344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] MFA Rules not processed for user `02a2e547ec144ef9a66c6d6e042a558e`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:25.670659 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:25.771924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a450b5f378d046cca901c08a36f5fb68', 'request_id': 'req-66e36c9e-9aca-4506-b029-b20e12fd632d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:25.783452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 977/1951] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:25.784133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a450b5f378d046cca901c08a36f5fb68', 'request_id': 'req-66e36c9e-9aca-4506-b029-b20e12fd632d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:25.792232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.795467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:25.862494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a450b5f378d046cca901c08a36f5fb68', 'request_id': 'req-66e36c9e-9aca-4506-b029-b20e12fd632d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:25.864138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a09b18-4376-49b7-833d-39d445f64307 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.879696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] The token cache is being invalidate because project a450b5f378d046cca901c08a36f5fb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:25.880431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:25.882846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:25.885317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 975/1952] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:25 2022] DELETE /identity/v3/projects/a450b5f378d046cca901c08a36f5fb68 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:25.889270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:25.890886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:25.937641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.938873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.939154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.939428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.941523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:25.979099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36c9e-9aca-4506-b029-b20e12fd632d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:25.990078 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:25.991508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:25.993699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:25.994187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] PATH_INFO: `/v3/users/a6600bf76c224ddfae870fa4864c25cc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:25.998375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6600bf76c224ddfae870fa4864c25cc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:25.998994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:26.073922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:26.075522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:26.098991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 978/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:26.103087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:26.106330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:26.143644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2c848-2891-49ea-ade2-dbc4067f551d service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:26.155947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:26.159495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:26.160140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:26.161825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] PATH_INFO: `/v3/projects/97a6db1ee2c54c65ab10e33619ccb8f9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:26.164783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a6db1ee2c54c65ab10e33619ccb8f9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:26.168480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:26.212286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6600bf76c224ddfae870fa4864c25cc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.308662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6600bf76c224ddfae870fa4864c25cc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.317035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6600bf76c224ddfae870fa4864c25cc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.317957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6600bf76c224ddfae870fa4864c25cc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.318588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6600bf76c224ddfae870fa4864c25cc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.350418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 976/1954] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:25 2022] DELETE /identity/v3/users/a6600bf76c224ddfae870fa4864c25cc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:26.364365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a6db1ee2c54c65ab10e33619ccb8f9', 'request_id': 'req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.370881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a6db1ee2c54c65ab10e33619ccb8f9', 'request_id': 'req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.451410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a6db1ee2c54c65ab10e33619ccb8f9', 'request_id': 'req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.463933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] The token cache is being invalidate because project 97a6db1ee2c54c65ab10e33619ccb8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:26.464309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.464870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.466478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 979/1955] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:26 2022] DELETE /identity/v3/projects/97a6db1ee2c54c65ab10e33619ccb8f9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:26.471018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:26.473291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:26.584707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b8009-c2ed-4c91-b6ce-80c8f68e7562 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:26.593191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:26.598571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:26.598571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:26.598571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] PATH_INFO: `/v3/users/56d3eb02585e46eab783b5b4c9461f62` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:26.599362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d3eb02585e46eab783b5b4c9461f62)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:26.602049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:26.849581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d3eb02585e46eab783b5b4c9461f62'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:26.951674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:26.954573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:26.980786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d3eb02585e46eab783b5b4c9461f62'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.002351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d3eb02585e46eab783b5b4c9461f62'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.003115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d3eb02585e46eab783b5b4c9461f62'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.004916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0b2cd09b-b70c-4882-9659-1512e0a8a01a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d3eb02585e46eab783b5b4c9461f62'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.040178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 977/1956] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:26 2022] DELETE /identity/v3/users/56d3eb02585e46eab783b5b4c9461f62 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:27.067794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf175a3-b26f-477e-9b56-c909bc2f2a0d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:27.139722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:27.140567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:27.140852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:27.141128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] PATH_INFO: `/v3/projects/5079c4175cc6417b86098d6c32f97c5b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:27.142939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5079c4175cc6417b86098d6c32f97c5b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:27.144895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:27.311748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5079c4175cc6417b86098d6c32f97c5b', 'request_id': 'req-fc387a37-e9fa-40a7-a366-1e30af89c38f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.319274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5079c4175cc6417b86098d6c32f97c5b', 'request_id': 'req-fc387a37-e9fa-40a7-a366-1e30af89c38f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.398151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5079c4175cc6417b86098d6c32f97c5b', 'request_id': 'req-fc387a37-e9fa-40a7-a366-1e30af89c38f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.422005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] The token cache is being invalidate because project 5079c4175cc6417b86098d6c32f97c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:27.427275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.428174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.432555 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 980/1957] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:26 2022] DELETE /identity/v3/projects/5079c4175cc6417b86098d6c32f97c5b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:27.437302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:27.437784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:27.438770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:27.476555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:27.482033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:27.598807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:27.604457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:27.674345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 978/1958] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:27.676531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:27.684661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:27.739442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc387a37-e9fa-40a7-a366-1e30af89c38f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:27.748054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:27.749794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:27.751523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:27.752195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] PATH_INFO: `/v3/projects/7c08567f2f3a4fb38dd0cfe889060ca7` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:27.754874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c08567f2f3a4fb38dd0cfe889060ca7)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:27.757527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:27.765182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2986b5-23ff-4a99-a109-2473a92f381e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:27.770087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:27.771511 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:27.772204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:27.772917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:27.775215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:27.859089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:27.861177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6344c-cc4a-4b0b-9fe9-5da56ea86757 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:27.892134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 979/1959] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:27.893804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:27.894285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:27.894762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:27.939146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:27.940468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:27.941724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c08567f2f3a4fb38dd0cfe889060ca7', 'request_id': 'req-90313682-3d78-4246-b922-f29f556116c5'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:27.952035 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c08567f2f3a4fb38dd0cfe889060ca7', 'request_id': 'req-90313682-3d78-4246-b922-f29f556116c5'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:28.027753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 980/1960] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:28.028713 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.029155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c08567f2f3a4fb38dd0cfe889060ca7', 'request_id': 'req-90313682-3d78-4246-b922-f29f556116c5'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:28.039372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe637-210b-4681-abaa-3ea83e23c1a2 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.044539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.045230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.045653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.045937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.046756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:28.047031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.047401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] The token cache is being invalidate because project 7c08567f2f3a4fb38dd0cfe889060ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:28.048575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:28.050040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.050444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90313682-3d78-4246-b922-f29f556116c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:28.053012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 981/1961] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:27 2022] DELETE /identity/v3/projects/7c08567f2f3a4fb38dd0cfe889060ca7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:28.058866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1cab0-eb67-4daa-9470-9146a33ce38e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.059087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1cab0-eb67-4daa-9470-9146a33ce38e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.059534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1cab0-eb67-4daa-9470-9146a33ce38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.080868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 981/1962] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:28.081777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.086796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:28.131459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6be1cab0-eb67-4daa-9470-9146a33ce38e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:28.133319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb100b-663b-476a-8649-8d74674748ae admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.138095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6be1cab0-eb67-4daa-9470-9146a33ce38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:28.140510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.141261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.146599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.147116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.147915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.149956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.178272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 982/1963] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:28.181478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.181829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.182166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.218579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:28.220952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:28.273891 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 983/1964] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:28.280099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.289794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75689c-84ec-4b7e-a0f7-3fb4701dd93b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.294773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.295658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.296169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.296672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.297674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:28.298360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.304050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.321296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 982/1965] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/projects => generated 407 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:28.324528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 984/1966] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:28.324874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.328942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.355775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb9e60-faa6-4226-998c-1dfafcc03655 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.443227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.444582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.444975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.445331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.446230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.448479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.499788 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685912a-2c06-4db7-be7b-717cfef2c8ad admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.505916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.508902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.508902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.508902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.508902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.510081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.560120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 985/1967] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:28.561147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.628622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25072dae-7112-498a-b8d8-e1ececa17600 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.637126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.637126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.637126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.637126 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.637544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.639492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.659517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 983/1968] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/users => generated 304 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:28.663819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.674064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba31ad-017a-43f3-9d85-c817e078e809 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.678767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.679621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.679925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.680205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.680976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.682590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.692851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 984/1969] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:28.696968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.706978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c8cc9-1a1b-482a-ae65-6ef6bc0b203d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.711639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.712289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.712576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.712855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.713581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.715170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.726364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 985/1970] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:28.730554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.741308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17fbf-c5dd-4cfa-9e5a-30354066bd03 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.746998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2291792-d68b-4515-bcc3-0c9d2e7e8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.747951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2291792-d68b-4515-bcc3-0c9d2e7e8bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.748239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2291792-d68b-4515-bcc3-0c9d2e7e8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.748517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2291792-d68b-4515-bcc3-0c9d2e7e8bfc admin admin] PATH_INFO: `/v3/projects/427a05bd2d6746e091136284986707bb/users/77e817a104fa408da8cda47db35b6a09/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.769273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2291792-d68b-4515-bcc3-0c9d2e7e8bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=427a05bd2d6746e091136284986707bb, user_id=77e817a104fa408da8cda47db35b6a09, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.772551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 986/1971] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:28.774588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2291792-d68b-4515-bcc3-0c9d2e7e8bfc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.776481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.789579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32480273-0bb9-4992-a740-bf886c6f7375 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.798240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.799686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.799986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.801207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.802130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.805089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.820260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 987/1972] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:28.827102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.839433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f21b7-d4f1-4576-a341-5b0b9cc8dd46 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.844708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.848306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.848306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.848306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.848306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.848890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.859024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 988/1973] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:28.863001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:28.879393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711b2c5-fe55-416b-9daf-259ea0676e99 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:28.884469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c1784-ca6a-40b0-83c7-a67c0bef51cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:28.885396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1784-ca6a-40b0-83c7-a67c0bef51cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.885683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1784-ca6a-40b0-83c7-a67c0bef51cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.885965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1784-ca6a-40b0-83c7-a67c0bef51cf admin admin] PATH_INFO: `/v3/projects/4057f383da7a4cafa547fcb477793e24/users/5a8057431e3b434eab5d6ce5fb7ad5cd/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.921262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 986/1974] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:28 2022] PUT /identity/v3/projects/427a05bd2d6746e091136284986707bb/users/77e817a104fa408da8cda47db35b6a09/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:28.921357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1784-ca6a-40b0-83c7-a67c0bef51cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4057f383da7a4cafa547fcb477793e24, user_id=5a8057431e3b434eab5d6ce5fb7ad5cd, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:28.921357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1784-ca6a-40b0-83c7-a67c0bef51cf admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:28.923361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:28.923682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:28.923964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:28.954515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] MFA Rules not processed for user `77e817a104fa408da8cda47db35b6a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:28.956010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:29.042993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 987/1975] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:29.043778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.047329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 989/1976] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:28 2022] PUT /identity/v3/projects/4057f383da7a4cafa547fcb477793e24/users/5a8057431e3b434eab5d6ce5fb7ad5cd/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:29.059559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.060977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.061448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.114243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] MFA Rules not processed for user `5a8057431e3b434eab5d6ce5fb7ad5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:29.117468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:29.135960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2e86-4209-48db-94f8-fb574405c34a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.211957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 990/1977] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:29.217292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.251284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.251996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.252280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.252557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.253259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.255197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.327957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e45180-8d76-4c0d-b3f4-c39eee05e62a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.334293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.334964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.335252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.335597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.336319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.338457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.394332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 988/1978] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:29 2022] POST /identity/v3/projects => generated 409 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:29.395868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.438342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 991/1979] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:29 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:29.439349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.441420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:29.471482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb87cc1-0b47-4552-9ce7-860b9ab03cc9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.520790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac4944-f3c3-4a7a-9038-c98827230a23 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.525248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.525913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.526199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.526600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.528410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:29.561223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.563681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.564123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.564547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.565539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.570383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.636455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.637988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.655201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 992/1980] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:29.655201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.663172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67206c-1a71-45f3-bd7e-9105e26e1f27 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.669682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.669682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.669682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.669682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.670153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.672123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.686447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 989/1981] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:29 2022] POST /identity/v3/users => generated 311 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:29.688928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.699898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d4f20-65dd-4ba8-9026-b40ed58c19f4 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.705275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.706239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.706663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.706918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.708264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.709864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.720790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 990/1982] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:29.725183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.735630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c847d-17dc-44ad-b1df-cf85419ad2c8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.740929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.741817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.742110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.742403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] PATH_INFO: `/v3/projects/e031ee855a20499fa657b0c9b7a97399/users/10df4b58d8b24e429f639098e5811832/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.759736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031ee855a20499fa657b0c9b7a97399, user_id=10df4b58d8b24e429f639098e5811832, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.760424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 993/1983] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:29 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:29.764773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.765565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.778544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b8d93-6892-4fdf-b4f1-5cb6a89aeb3b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.783687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.784358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.786682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.786682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.786682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.787479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.798250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 994/1984] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:29.802729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.812922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72587a39-6a4b-4bd6-aca8-1b85f7469b3b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.818204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.819087 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.819364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.819678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] PATH_INFO: `/v3/projects/2ac1db1ca03f476185c8d2cbb296aa13/users/51d815f94caf4bb59c86ca93020a638e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.843032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 991/1985] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:29 2022] PUT /identity/v3/projects/e031ee855a20499fa657b0c9b7a97399/users/10df4b58d8b24e429f639098e5811832/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:29.844215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.847819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac1db1ca03f476185c8d2cbb296aa13, user_id=51d815f94caf4bb59c86ca93020a638e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.856768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.911040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1244a-656e-48a9-acf3-58ff9b294e72 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.916136 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:29.916434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:29.916709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:29.916989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:29.917723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:29.919331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:29.931644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 992/1986] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:29.933692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:29.944640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de04cd-f450-48e3-b236-bd227771a6ec admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:29.948715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 995/1987] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:29 2022] PUT /identity/v3/projects/2ac1db1ca03f476185c8d2cbb296aa13/users/51d815f94caf4bb59c86ca93020a638e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:29.953197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:30.017092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a702c-119e-4fb7-b162-1611a2895179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.018036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a702c-119e-4fb7-b162-1611a2895179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.018322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a702c-119e-4fb7-b162-1611a2895179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.018600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a702c-119e-4fb7-b162-1611a2895179 admin admin] PATH_INFO: `/v3/projects/e031ee855a20499fa657b0c9b7a97399/users/10df4b58d8b24e429f639098e5811832/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.020616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a702c-119e-4fb7-b162-1611a2895179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e031ee855a20499fa657b0c9b7a97399, user_id=10df4b58d8b24e429f639098e5811832, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.023884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a702c-119e-4fb7-b162-1611a2895179 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.027708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2d9db-8ff9-483c-932e-f308236b501c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:30.033424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.034092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.034373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.034650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.035283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 993/1988] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:29 2022] PUT /identity/v3/projects/e031ee855a20499fa657b0c9b7a97399/users/10df4b58d8b24e429f639098e5811832/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:30.035387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.037298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.045663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.045913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.046214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.049407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 996/1989] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:30.054817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:30.065493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243bed0-fce8-4ba2-a20a-b7851ca03f77 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:30.074875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] MFA Rules not processed for user `10df4b58d8b24e429f639098e5811832`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:30.081492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:30.131950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac500de-4811-4916-a5a5-282baa7d5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.134461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac500de-4811-4916-a5a5-282baa7d5fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.134461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac500de-4811-4916-a5a5-282baa7d5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.134461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac500de-4811-4916-a5a5-282baa7d5fd2 admin admin] PATH_INFO: `/v3/projects/2ac1db1ca03f476185c8d2cbb296aa13/users/51d815f94caf4bb59c86ca93020a638e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.136405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac500de-4811-4916-a5a5-282baa7d5fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac1db1ca03f476185c8d2cbb296aa13, user_id=51d815f94caf4bb59c86ca93020a638e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.138924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac500de-4811-4916-a5a5-282baa7d5fd2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.151122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 994/1991] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:30.159678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 997/1991] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:30 2022] PUT /identity/v3/projects/2ac1db1ca03f476185c8d2cbb296aa13/users/51d815f94caf4bb59c86ca93020a638e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:30.163540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:30.164724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.164837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:30.165017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.165296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.193699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] MFA Rules not processed for user `51d815f94caf4bb59c86ca93020a638e`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:30.194918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:30.222264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6190525-4dea-4f68-963f-35888450beb2 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:30.262447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 998/1992] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:30.272559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.273236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.273531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.273791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.301708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:30.311383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3385fce-92e0-4e48-a513-7caa7ac14dd3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:30.315557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.316328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.316645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.316926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.329138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.331031 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.336916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.338372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.346478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 999/1993] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:30.349561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 995/1994] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:30.542989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:30.552074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff35d7-fbbc-4103-ba9d-29f25a07b36f service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:30.555735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.556366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.556653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.556931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.616884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.618530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.628521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1000/1995] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:30.722859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:30.731833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfae37d-ec64-4ad8-a185-977cbfcaf5c9 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:30.735629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0f699-c199-43e6-98cd-7f798ec4f25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:30.736255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f699-c199-43e6-98cd-7f798ec4f25b service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:30.736535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f699-c199-43e6-98cd-7f798ec4f25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:30.736828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f699-c199-43e6-98cd-7f798ec4f25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:30.793268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0f699-c199-43e6-98cd-7f798ec4f25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:30.794791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0f699-c199-43e6-98cd-7f798ec4f25b service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:30.803982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 996/1996] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:31.155562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:31.223253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6468-422c-421a-8b51-93a9e61281d2 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:31.228025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:31.228924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:31.229361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:31.229642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] PATH_INFO: `/v3/users/5a8057431e3b434eab5d6ce5fb7ad5cd` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:31.230971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a8057431e3b434eab5d6ce5fb7ad5cd)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:31.233237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:31.399590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a8057431e3b434eab5d6ce5fb7ad5cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:31.462522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a8057431e3b434eab5d6ce5fb7ad5cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:31.470315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a8057431e3b434eab5d6ce5fb7ad5cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:31.471041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a8057431e3b434eab5d6ce5fb7ad5cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:31.483164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a8057431e3b434eab5d6ce5fb7ad5cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:31.489478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1001/1997] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:31 2022] DELETE /identity/v3/users/5a8057431e3b434eab5d6ce5fb7ad5cd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:31.493933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:31.494222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:31.494501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:31.511987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:31.513187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:31.587144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 997/1998] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:31.596599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:31.598105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:31.664830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dd0a4-1962-457a-a97f-d9c461f27788 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:31.669483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:31.671167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:31.671456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:31.671797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:31.698088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:31.698650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:31.730398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1002/1999] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:32.178444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:32.179973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:32.192388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de9e2-4f02-4711-80bd-ffba3ffe562b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:32.197282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:32.198576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:32.198870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:32.199325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] PATH_INFO: `/v3/projects/4057f383da7a4cafa547fcb477793e24` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:32.200767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4057f383da7a4cafa547fcb477793e24)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:32.202793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:32.356645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4057f383da7a4cafa547fcb477793e24', 'request_id': 'req-ea53e165-c443-42dc-ae24-c0cfe652bcfc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.361971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4057f383da7a4cafa547fcb477793e24', 'request_id': 'req-ea53e165-c443-42dc-ae24-c0cfe652bcfc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.462209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4057f383da7a4cafa547fcb477793e24', 'request_id': 'req-ea53e165-c443-42dc-ae24-c0cfe652bcfc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.474101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] The token cache is being invalidate because project 4057f383da7a4cafa547fcb477793e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:32.474395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.475024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.476603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 998/2000] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:32 2022] DELETE /identity/v3/projects/4057f383da7a4cafa547fcb477793e24 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:32.480590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:32.490096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22dbd-b7aa-435e-8d7e-e60d3a5633e7 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:32.545060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:32.545841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:32.546121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:32.546392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] PATH_INFO: `/v3/users/51d815f94caf4bb59c86ca93020a638e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:32.547554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d815f94caf4bb59c86ca93020a638e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:32.549561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:32.760507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d815f94caf4bb59c86ca93020a638e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.854851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d815f94caf4bb59c86ca93020a638e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.868368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d815f94caf4bb59c86ca93020a638e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.868368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d815f94caf4bb59c86ca93020a638e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.877989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d815f94caf4bb59c86ca93020a638e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:32.885392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1003/2001] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:32 2022] DELETE /identity/v3/users/51d815f94caf4bb59c86ca93020a638e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:33.271633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:33.273264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:33.333498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53e165-c443-42dc-ae24-c0cfe652bcfc admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:33.338562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:33.340027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:33.393327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:33.393327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:33.393327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:33.393327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:33.393862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:33.418972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb9858-5c45-4dc5-b5dd-2f3684babbb1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:33.424437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:33.425771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:33.426155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:33.426533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] PATH_INFO: `/v3/projects/2ac1db1ca03f476185c8d2cbb296aa13` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:33.428023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac1db1ca03f476185c8d2cbb296aa13)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:33.430377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:33.477411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:33.478955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305043-7fd1-4afe-846a-1341b038c0f4 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:33.493462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 999/2002] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:33.560371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac1db1ca03f476185c8d2cbb296aa13', 'request_id': 'req-0d7a130b-e53b-4570-a928-8f91a37be229'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:33.567022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac1db1ca03f476185c8d2cbb296aa13', 'request_id': 'req-0d7a130b-e53b-4570-a928-8f91a37be229'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:33.708352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac1db1ca03f476185c8d2cbb296aa13', 'request_id': 'req-0d7a130b-e53b-4570-a928-8f91a37be229'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:33.725356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] The token cache is being invalidate because project 2ac1db1ca03f476185c8d2cbb296aa13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:33.725852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:33.727061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0d7a130b-e53b-4570-a928-8f91a37be229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:33.730580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1004/2003] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:33 2022] DELETE /identity/v3/projects/2ac1db1ca03f476185c8d2cbb296aa13 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:33.741159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:33.741751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:33.742540 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:33.775482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:33.775482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:33.829438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1000/2004] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:33.837222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:33.837519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:33.837856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:33.855677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:33.856872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:33.865440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1005/2005] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:33.869485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:33.879589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d39af-e5bf-4de9-94c1-7560ebf2bec4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:33.884317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:33.887506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:33.887506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:33.887506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:33.887506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:33.887506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:33.888230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:33.899837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1001/2006] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:33.904146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:33.913562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc843d-d5e9-4739-b9bb-ca49cd362db8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:33.918632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:33.919303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:33.919586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:33.919895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:33.920620 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:33.923082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:34.001313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1006/2007] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:33 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:34.005447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:34.015464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222a6c-2fbf-4dfa-80a0-59d6b9457c23 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:34.084185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:34.084988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:34.085276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:34.085551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:34.086707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:34.088264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:34.186276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1002/2008] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:34 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:34.190782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:34.200795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1d640-fd7e-4a52-a4ac-e31f20e26be4 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:34.206330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:34.206982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:34.207264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:34.207538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:34.208299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:34.210057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:34.221387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1007/2009] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:34.225539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:34.236253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876b28-6d70-41b9-964b-b2e0f758e38e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:34.240930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb9b08-2c9b-462e-9892-5b3f1dc92294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:34.241586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9b08-2c9b-462e-9892-5b3f1dc92294 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:34.241871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9b08-2c9b-462e-9892-5b3f1dc92294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:34.242194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb9b08-2c9b-462e-9892-5b3f1dc92294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:34.242928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9b08-2c9b-462e-9892-5b3f1dc92294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:34.244600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb9b08-2c9b-462e-9892-5b3f1dc92294 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:34.254533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1003/2010] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:34.259760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:34.269790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf534b5-9efc-48ac-b6f6-0eff6bd79741 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:34.274467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:34.275345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:34.275650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:34.275934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] PATH_INFO: `/v3/projects/0ec724d38c4048058eee37b9a405f907/users/14db42a54c7a499e9b424a410b01b478/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:34.292005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec724d38c4048058eee37b9a405f907, user_id=14db42a54c7a499e9b424a410b01b478, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:34.294806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:34.382761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1008/2011] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:34 2022] PUT /identity/v3/projects/0ec724d38c4048058eee37b9a405f907/users/14db42a54c7a499e9b424a410b01b478/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:34.424625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:34.424625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:34.424625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:34.434858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] MFA Rules not processed for user `14db42a54c7a499e9b424a410b01b478`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:34.436168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:34.506160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1004/2012] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:34.517920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:34.519635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:34.575369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0db6f-6fd7-4b67-85df-65ce3a11c90b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:34.579927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3a3e4-feb2-4d87-b9a2-f9557a1b3ac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:34.580590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a3e4-feb2-4d87-b9a2-f9557a1b3ac7 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:34.580877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a3e4-feb2-4d87-b9a2-f9557a1b3ac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:34.581164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3a3e4-feb2-4d87-b9a2-f9557a1b3ac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:34.590074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a3e4-feb2-4d87-b9a2-f9557a1b3ac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:34.591503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3a3e4-feb2-4d87-b9a2-f9557a1b3ac7 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:34.601221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1009/2013] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:38.903171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:38.904656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:38.974030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847694c-b04d-40b0-b401-0c341f886bcd None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:38.978722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:38.979594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:38.979900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:38.980175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] PATH_INFO: `/v3/users/51ff5d681f4745f5abb16d7a895cd613` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:38.981422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ff5d681f4745f5abb16d7a895cd613)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:38.983295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:39.148191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ff5d681f4745f5abb16d7a895cd613'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.211230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ff5d681f4745f5abb16d7a895cd613'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.218569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ff5d681f4745f5abb16d7a895cd613'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.220252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ff5d681f4745f5abb16d7a895cd613'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.220398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ff5d681f4745f5abb16d7a895cd613'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.238192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1005/2014] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:38 2022] DELETE /identity/v3/users/51ff5d681f4745f5abb16d7a895cd613 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:39.242949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:39.253162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:39.253162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:39.261190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:39.262371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:39.319636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1010/2015] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:39.329239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:39.330670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:39.388167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e59f7-321f-4171-b1a0-3123744d48d7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:39.392125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42059bf1-a328-469a-b519-3060f040c73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:39.393070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42059bf1-a328-469a-b519-3060f040c73a service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:39.393184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42059bf1-a328-469a-b519-3060f040c73a service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:39.393397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42059bf1-a328-469a-b519-3060f040c73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:39.403049 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42059bf1-a328-469a-b519-3060f040c73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:39.404585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42059bf1-a328-469a-b519-3060f040c73a service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:39.415235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1006/2016] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:39.416501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:39.417886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:39.432139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c267caa-7c7e-4601-a21b-af3983e4fbc1 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:39.436750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:39.437627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:39.438025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:39.438181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] PATH_INFO: `/v3/users/c29a9f9a0b52410ba5ac2a44be4caf6a` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:39.439402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c29a9f9a0b52410ba5ac2a44be4caf6a)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:39.441356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:39.636577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c29a9f9a0b52410ba5ac2a44be4caf6a'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.708382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c29a9f9a0b52410ba5ac2a44be4caf6a'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.718075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c29a9f9a0b52410ba5ac2a44be4caf6a'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.719020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c29a9f9a0b52410ba5ac2a44be4caf6a'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.733253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c29a9f9a0b52410ba5ac2a44be4caf6a'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.739858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1011/2017] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:39 2022] DELETE /identity/v3/users/c29a9f9a0b52410ba5ac2a44be4caf6a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:39.744528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:39.744837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:39.745125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:39.763197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:39.764435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:39.822042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1007/2018] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:39.832421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:39.833839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:39.834523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:39.835592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:39.849481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde3a1-70c6-47d2-8f5d-038708932235 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:39.854917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:39.856283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:39.856569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:39.856987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] PATH_INFO: `/v3/projects/1db5f635bf7343cdbf9baac6bbb9951c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:39.858808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db5f635bf7343cdbf9baac6bbb9951c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:39.861794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:39.898479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a240-d8a7-477e-b0b0-4a3cc1c3c96f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:39.902100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:39.902774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:39.903057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:39.903331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:39.913228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:39.914646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:39.924397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1012/2019] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:39.974282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db5f635bf7343cdbf9baac6bbb9951c', 'request_id': 'req-76c7da36-e472-4089-b014-f278cf30d335'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:39.980167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db5f635bf7343cdbf9baac6bbb9951c', 'request_id': 'req-76c7da36-e472-4089-b014-f278cf30d335'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.060703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db5f635bf7343cdbf9baac6bbb9951c', 'request_id': 'req-76c7da36-e472-4089-b014-f278cf30d335'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.074481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] The token cache is being invalidate because project 1db5f635bf7343cdbf9baac6bbb9951c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:40.074897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.075654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.077556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1008/2020] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:39 2022] DELETE /identity/v3/projects/1db5f635bf7343cdbf9baac6bbb9951c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:40.082129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:40.091808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb67165-ef08-447d-a89c-a518f42be88a service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:40.147434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:40.148256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:40.148535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:40.148807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] PATH_INFO: `/v3/users/86fa654e08ce4b0f968d268d132339f4` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:40.149986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fa654e08ce4b0f968d268d132339f4)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:40.151924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:40.344483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fa654e08ce4b0f968d268d132339f4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.433780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fa654e08ce4b0f968d268d132339f4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.434745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:40.436675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:40.449972 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7da36-e472-4089-b014-f278cf30d335 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:40.455331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:40.456035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:40.456334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:40.456602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] PATH_INFO: `/v3/projects/ef25f5c8cc494b72a911e506ce6aca22` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:40.457793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef25f5c8cc494b72a911e506ce6aca22)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:40.459747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:40.461487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fa654e08ce4b0f968d268d132339f4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.462717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fa654e08ce4b0f968d268d132339f4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.478154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fa654e08ce4b0f968d268d132339f4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.484172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1013/2021] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:40 2022] DELETE /identity/v3/users/86fa654e08ce4b0f968d268d132339f4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:40.571227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef25f5c8cc494b72a911e506ce6aca22', 'request_id': 'req-c11f0c18-a73b-46dc-97b2-984b655e5adc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.576647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef25f5c8cc494b72a911e506ce6aca22', 'request_id': 'req-c11f0c18-a73b-46dc-97b2-984b655e5adc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.639248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef25f5c8cc494b72a911e506ce6aca22', 'request_id': 'req-c11f0c18-a73b-46dc-97b2-984b655e5adc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.650549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] The token cache is being invalidate because project ef25f5c8cc494b72a911e506ce6aca22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:40.650829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.651461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:40.653184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1009/2022] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:40 2022] DELETE /identity/v3/projects/ef25f5c8cc494b72a911e506ce6aca22 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:40.657076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:40.658479 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:40.723062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af12a-9664-4d8d-a6af-ef86d91c9a71 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:40.778241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:40.779227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:40.779371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:40.779673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] PATH_INFO: `/v3/users/8fcc72d867cc42a69e826dcd9f2aa680` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:40.781096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fcc72d867cc42a69e826dcd9f2aa680)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:40.783743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:40.875237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:40.876734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:40.892604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f0c18-a73b-46dc-97b2-984b655e5adc admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:40.897908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:40.899353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:40.900191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:40.900191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] PATH_INFO: `/v3/projects/7ef70a25956f42b29c2c2c4d3a789e41` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:40.901291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef70a25956f42b29c2c2c4d3a789e41)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:40.903197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:40.949731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fcc72d867cc42a69e826dcd9f2aa680'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.025766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef70a25956f42b29c2c2c4d3a789e41', 'request_id': 'req-454b1174-9834-4fd6-afcd-afdf8677f768'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.031126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef70a25956f42b29c2c2c4d3a789e41', 'request_id': 'req-454b1174-9834-4fd6-afcd-afdf8677f768'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.037581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fcc72d867cc42a69e826dcd9f2aa680'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.045081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fcc72d867cc42a69e826dcd9f2aa680'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.045725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fcc72d867cc42a69e826dcd9f2aa680'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.058133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f5887397-4011-483a-82cc-e34249086760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fcc72d867cc42a69e826dcd9f2aa680'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.064053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1014/2023] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:40 2022] DELETE /identity/v3/users/8fcc72d867cc42a69e826dcd9f2aa680 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:41.119505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef70a25956f42b29c2c2c4d3a789e41', 'request_id': 'req-454b1174-9834-4fd6-afcd-afdf8677f768'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.133236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] The token cache is being invalidate because project 7ef70a25956f42b29c2c2c4d3a789e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:41.133532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.134593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-454b1174-9834-4fd6-afcd-afdf8677f768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.136557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1010/2024] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:40 2022] DELETE /identity/v3/projects/7ef70a25956f42b29c2c2c4d3a789e41 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:41.142968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.143468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.143785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.165383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:41.166682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:41.226461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1015/2025] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:41.234697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.235709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.236066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.254548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:41.255896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:41.264028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1011/2026] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:41.268044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.277502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805fdac-b9fa-4a98-80c9-64dd9c6328e8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.282038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.282705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.282972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.283251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.284010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:41.284317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.286177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.298448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1016/2027] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:41.310080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.322803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b141bd-3877-49ca-b597-468be90d2caf None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.328436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.329171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.329545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.329896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.330660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.332774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.456912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1012/2028] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:41 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:41.461350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.472463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654245f-96ec-443f-86a6-cfe2328d8d16 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.528985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.529693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.530006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.530237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.530951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.533409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.569390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.571256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:41.584750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504760e8-08e4-4f51-943a-ad2c5205d7c7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.590855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.591989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.592384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.592766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] PATH_INFO: `/v3/projects/56258a6d0d39454ba7de61ee54089508` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.594885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56258a6d0d39454ba7de61ee54089508)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.597010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.685957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1017/2029] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:41 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:41.690692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.700855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee15e1-6eda-483d-82b5-a014f24a638d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.706294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.707284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.707798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.707919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.708720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.710518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.728146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1018/2030] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:41.728253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56258a6d0d39454ba7de61ee54089508', 'request_id': 'req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.729195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.733539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56258a6d0d39454ba7de61ee54089508', 'request_id': 'req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.739412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796b164-ae5d-4664-af99-475705feaf17 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.800141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.800875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.801161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.801444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.802178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.803807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.814372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1019/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:41.818275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.831915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69c183-0151-4380-8a61-2febfa4c9416 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.837113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720de53-d08c-4219-a9b8-ada57a0c3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.838036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720de53-d08c-4219-a9b8-ada57a0c3cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.838320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720de53-d08c-4219-a9b8-ada57a0c3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.838595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720de53-d08c-4219-a9b8-ada57a0c3cfe admin admin] PATH_INFO: `/v3/projects/23ff4d9fc6654180a6a1338cbf6d48e1/users/a61d16e2f72346b6aa5c55a652fe2cb6/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.854352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720de53-d08c-4219-a9b8-ada57a0c3cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ff4d9fc6654180a6a1338cbf6d48e1, user_id=a61d16e2f72346b6aa5c55a652fe2cb6, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.857231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720de53-d08c-4219-a9b8-ada57a0c3cfe admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.869067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56258a6d0d39454ba7de61ee54089508', 'request_id': 'req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.881826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] The token cache is being invalidate because project 56258a6d0d39454ba7de61ee54089508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:41.882231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.882877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:41.884561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1013/2032] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:41 2022] DELETE /identity/v3/projects/56258a6d0d39454ba7de61ee54089508 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:41.894549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:41.896104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:41.908881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d272-a44b-46f5-a28b-c9d79d23dbeb admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:41.913880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:41.914745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.915027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.915299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] PATH_INFO: `/v3/users/02a2e547ec144ef9a66c6d6e042a558e` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.918697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a2e547ec144ef9a66c6d6e042a558e)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:41.918697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:41.943332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1020/2033] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:41 2022] PUT /identity/v3/projects/23ff4d9fc6654180a6a1338cbf6d48e1/users/a61d16e2f72346b6aa5c55a652fe2cb6/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:41.955693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:41.955949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:41.956227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:41.987396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] MFA Rules not processed for user `a61d16e2f72346b6aa5c55a652fe2cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:41.987396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:42.051827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1021/2034] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:42.065749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:42.067158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:42.111427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a2e547ec144ef9a66c6d6e042a558e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:42.129862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb35e6-3416-4d1d-8d8b-788b43be6ffd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:42.133509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:42.134158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:42.134512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:42.134796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:42.143230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:42.144696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:42.153811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1022/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:42.199681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a2e547ec144ef9a66c6d6e042a558e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:42.207396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a2e547ec144ef9a66c6d6e042a558e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:42.208111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a2e547ec144ef9a66c6d6e042a558e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:42.209426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c8358a1-66bb-4b6b-8c08-43f3aa0e7777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a2e547ec144ef9a66c6d6e042a558e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:42.227721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1014/2036] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:41 2022] DELETE /identity/v3/users/02a2e547ec144ef9a66c6d6e042a558e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:42.725358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:42.797608 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5076-ae6a-4fcf-baf1-977c3f28a7c8 service glance] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:42.862820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:42.863716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:42.863996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:42.864289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] PATH_INFO: `/v3/projects/040d22f78f8146db8a4cbca7a4070319` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:42.865464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040d22f78f8146db8a4cbca7a4070319)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:42.867398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:42.964820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040d22f78f8146db8a4cbca7a4070319', 'request_id': 'req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:42.970482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040d22f78f8146db8a4cbca7a4070319', 'request_id': 'req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:43.054668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040d22f78f8146db8a4cbca7a4070319', 'request_id': 'req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:43.066540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] The token cache is being invalidate because project 040d22f78f8146db8a4cbca7a4070319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:43.066828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:43.067464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-82bb83bd-1eb0-44fb-bf7d-e77a4aa691c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:43.069144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1023/2037] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:42 2022] DELETE /identity/v3/projects/040d22f78f8146db8a4cbca7a4070319 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:43.075902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.076247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.076464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.095730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:43.096929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:43.169886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1015/2038] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:43.177964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.178267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.178543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.197051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:43.198265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:43.206654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1024/2039] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:43.210716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.220600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb67087-df5b-4044-89aa-fe0a692a00fe None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.225286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.225991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.226262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.226544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.228125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:43.230887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.230887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.241665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1016/2040] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:43.246258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.257697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabebb1-e300-4a37-92ad-10a6d4cc9a50 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.261946 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.262615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.263105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.263391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.264182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.266679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.368544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1025/2041] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:43 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:43.372803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.383314 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3445a-987b-4848-85ee-aff6e127f2f3 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.438981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.439789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.440073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.440352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.441043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.442960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.512291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1017/2042] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:43 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:43.513515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.526015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ce579-6b9a-4d18-86c7-47b86f234609 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.529641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.530303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.530586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.530867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.531599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.533243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.546654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1026/2043] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:43.550410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.561439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad264bd-344a-4beb-bfd7-f6b1caf05378 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.567033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c8fd5-d530-427c-ae59-a13c8c6352fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.567860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c8fd5-d530-427c-ae59-a13c8c6352fb admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.568143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c8fd5-d530-427c-ae59-a13c8c6352fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.568417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c8fd5-d530-427c-ae59-a13c8c6352fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.569140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c8fd5-d530-427c-ae59-a13c8c6352fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.571926 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c8fd5-d530-427c-ae59-a13c8c6352fb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.584598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1018/2044] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:43.588677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.601543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77375ab8-8ed9-4c32-872f-6fa1eb30be7c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.608059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.609010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.609383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.609722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] PATH_INFO: `/v3/projects/050ced58dcaf4eafbc8cd7373a84f7ad/users/1efbff9cd62d4dee8d5b0fb1231a077c/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.641160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] RBAC: Authorizing `identity:create_grant(project_id=050ced58dcaf4eafbc8cd7373a84f7ad, user_id=1efbff9cd62d4dee8d5b0fb1231a077c, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.646652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.714951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1027/2045] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:43 2022] PUT /identity/v3/projects/050ced58dcaf4eafbc8cd7373a84f7ad/users/1efbff9cd62d4dee8d5b0fb1231a077c/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:43.729214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.729508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.729935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.738058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.743050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:43.766670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] MFA Rules not processed for user `1efbff9cd62d4dee8d5b0fb1231a077c`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:43.768001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:43.823062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556a587-6cea-4be7-b8ff-bb7d1461516e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.828803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.829989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.830340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.830689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] PATH_INFO: `/v3/users/77e817a104fa408da8cda47db35b6a09` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.832216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e817a104fa408da8cda47db35b6a09)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.834261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:43.881573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1019/2046] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:43.886070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:43.896623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fecfb9-49bc-4281-985a-2e05530041a3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:43.901311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:43.902112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:43.902478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:43.902826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:43.903650 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:43.905572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.018736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1020/2047] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:43 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:44.030467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.038517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e817a104fa408da8cda47db35b6a09'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:44.094093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f552-9674-425f-9550-ad6b67b2ebe1 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.099556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.100257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.100581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.100876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.101568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.103559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.118078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e817a104fa408da8cda47db35b6a09'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:44.128529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e817a104fa408da8cda47db35b6a09'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:44.129376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e817a104fa408da8cda47db35b6a09'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:44.141864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b571d6a8-586f-4de0-be90-669e6ce148b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e817a104fa408da8cda47db35b6a09'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:44.148308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1028/2048] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:43 2022] DELETE /identity/v3/users/77e817a104fa408da8cda47db35b6a09 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:44.156619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.156909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.157275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.176299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:44.177784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:44.235740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1029/2049] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:44.245924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.247351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:44.280430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1021/2050] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:44 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:44.288852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.292138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:44.304652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35518a84-d334-4602-9839-f2dd0eea5a20 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.311796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.311796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.311796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.311796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.312399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.314039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.318764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fee51-7ced-40e0-ad6a-2cc3644417ea None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.322483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.323135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.323420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.323733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.331595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1022/2051] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:44.332564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.333188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.334630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.341788 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83747d71-00b8-4b91-9e56-75850fcadc55 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.345647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1030/2052] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:44.346369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.347227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.347503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.347801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] PATH_INFO: `/v3/projects/98ebdc966fab489e92264a822c7f79de/users/87640070f64942ee8f14f1862ac0992f/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.363170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ebdc966fab489e92264a822c7f79de, user_id=87640070f64942ee8f14f1862ac0992f, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.366349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.451084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1023/2053] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:44 2022] PUT /identity/v3/projects/98ebdc966fab489e92264a822c7f79de/users/87640070f64942ee8f14f1862ac0992f/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:44.455696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.469667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03852f6-15c0-4c8b-9e43-32b8a95fc243 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.534224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b5a15-a7b9-4321-b6a8-a8df096e4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.535079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5a15-a7b9-4321-b6a8-a8df096e4844 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.535458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5a15-a7b9-4321-b6a8-a8df096e4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.535967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b5a15-a7b9-4321-b6a8-a8df096e4844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.536716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b5a15-a7b9-4321-b6a8-a8df096e4844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.538333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b5a15-a7b9-4321-b6a8-a8df096e4844 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.550882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1031/2054] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:44.553812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.564031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66980f-b258-4154-bcb5-b17d4240d64d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.568740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.569628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.569903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.570176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] PATH_INFO: `/v3/projects/98ebdc966fab489e92264a822c7f79de/users/87640070f64942ee8f14f1862ac0992f/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.572142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ebdc966fab489e92264a822c7f79de, user_id=87640070f64942ee8f14f1862ac0992f, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.574814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.585551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1024/2055] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:44 2022] PUT /identity/v3/projects/98ebdc966fab489e92264a822c7f79de/users/87640070f64942ee8f14f1862ac0992f/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:44.597689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.598178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.598461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.626227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] MFA Rules not processed for user `87640070f64942ee8f14f1862ac0992f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:44.627435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:44.694592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1032/2056] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:44.706142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.707874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:44.750367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:44.752892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:44.765269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cd7b4-8f46-4fe5-8b38-b1105106f0b0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.779462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.780160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.780434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.780919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.792648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.793478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.803731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1025/2057] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:44.831418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84618c22-0541-4949-ac83-7700a3f8593e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:44.845430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:44.846619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:44.846927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:44.850006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] PATH_INFO: `/v3/projects/427a05bd2d6746e091136284986707bb` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:44.850006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=427a05bd2d6746e091136284986707bb)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:44.850534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:44.989776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427a05bd2d6746e091136284986707bb', 'request_id': 'req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:44.989776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427a05bd2d6746e091136284986707bb', 'request_id': 'req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.095973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:45.100539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427a05bd2d6746e091136284986707bb', 'request_id': 'req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.105138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5a8bc-4647-45b6-8996-1eb8c862ea6d service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:45.113365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] The token cache is being invalidate because project 427a05bd2d6746e091136284986707bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:45.113646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.114589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.116786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1033/2058] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:44 2022] DELETE /identity/v3/projects/427a05bd2d6746e091136284986707bb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:45.120412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:45.121675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:45.159384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:45.160078 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:45.160416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:45.160690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:45.163284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:45.192815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf62a5-c9c2-42c2-86ab-4889809f3f7f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:45.204656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:45.204656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:45.204656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:45.204656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] PATH_INFO: `/v3/users/10df4b58d8b24e429f639098e5811832` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:45.205023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10df4b58d8b24e429f639098e5811832)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:45.205023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:45.234230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:45.236817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:45.248636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1026/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:45 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:45.404672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10df4b58d8b24e429f639098e5811832'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.477179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10df4b58d8b24e429f639098e5811832'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.484455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10df4b58d8b24e429f639098e5811832'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.485757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10df4b58d8b24e429f639098e5811832'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.497235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33ff6a02-6cce-48f5-9898-0bd6825580e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10df4b58d8b24e429f639098e5811832'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:45.503003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1034/2060] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:45 2022] DELETE /identity/v3/users/10df4b58d8b24e429f639098e5811832 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:45.947721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:45.963826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809b086-adec-4da9-8291-905db3af71b2 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.025691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.026553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.026834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.027110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] PATH_INFO: `/v3/projects/e031ee855a20499fa657b0c9b7a97399` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.028347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e031ee855a20499fa657b0c9b7a97399)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.030324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.146022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e031ee855a20499fa657b0c9b7a97399', 'request_id': 'req-3547262a-af7c-43d5-a29b-9de7a1c31b35'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:46.151208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e031ee855a20499fa657b0c9b7a97399', 'request_id': 'req-3547262a-af7c-43d5-a29b-9de7a1c31b35'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:46.227860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e031ee855a20499fa657b0c9b7a97399', 'request_id': 'req-3547262a-af7c-43d5-a29b-9de7a1c31b35'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:46.244407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] The token cache is being invalidate because project e031ee855a20499fa657b0c9b7a97399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:46.244719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:46.245588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3547262a-af7c-43d5-a29b-9de7a1c31b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:46.247181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1027/2061] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:45 2022] DELETE /identity/v3/projects/e031ee855a20499fa657b0c9b7a97399 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:46.252039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.252550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.252721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.270443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:46.271657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:46.329610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1035/2062] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:46.337621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.337937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.338217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.357563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:46.358530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:46.366323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1028/2063] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:46.370520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:46.380384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423759e-6968-45f1-8474-12c85bae5515 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.388124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.388688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.388982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.389267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.390015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:46.390327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.392601 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.405473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1036/2064] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:50:46.419033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:46.428160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925e1e5-79fa-47c0-b94f-f9c16bba5cff None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.432823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.433455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.433732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.434004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.434682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.436714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.539615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1029/2065] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:46 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:46.543770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:46.553583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e0c90-58f4-48df-891b-2ee302bb34f6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.607795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.608449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.608729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.609034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.609730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.612458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.691132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1037/2066] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:46 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:46.700045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:46.710267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a54d0a-ce2e-4021-8b69-597fa9243180 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.714975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.715652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.715936 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.716213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.716945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.718577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.729279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1030/2067] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:46.733097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:46.743425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2a387-3af5-4b92-90ac-fc0b65ef8fea admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.748155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dd110-cde4-4af2-8e38-f2e9e853f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.748794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd110-cde4-4af2-8e38-f2e9e853f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.749078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd110-cde4-4af2-8e38-f2e9e853f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.749354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dd110-cde4-4af2-8e38-f2e9e853f6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.750079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd110-cde4-4af2-8e38-f2e9e853f6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.751693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7dd110-cde4-4af2-8e38-f2e9e853f6d2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.761267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1038/2068] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:50:46.765151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:46.774686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb4e1a-db97-49f1-a53d-add98da4b12b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:46.779233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:46.780120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.780402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.780675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] PATH_INFO: `/v3/projects/50c4bf98965441678e2181db5293f64a/users/bee3277080884574948a6f9ca8eaf56d/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.797204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c4bf98965441678e2181db5293f64a, user_id=bee3277080884574948a6f9ca8eaf56d, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:46.800566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:46.909182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1031/2069] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:46 2022] PUT /identity/v3/projects/50c4bf98965441678e2181db5293f64a/users/bee3277080884574948a6f9ca8eaf56d/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:46.914861 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9c56b-f887-4463-873e-dd5edb0e68b0 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:46.915216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9c56b-f887-4463-873e-dd5edb0e68b0 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:46.915563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9c56b-f887-4463-873e-dd5edb0e68b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:46.933567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-33f9c56b-f887-4463-873e-dd5edb0e68b0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:46.934805 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-33f9c56b-f887-4463-873e-dd5edb0e68b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:46.996212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1039/2070] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:47.005717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:47.013187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:47.064983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70d57f-5702-46e7-b676-3066d9b919ac admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:47.068660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:47.069355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:47.069643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:47.069921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:47.079416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:47.080997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:47.090328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1032/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:48.527945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:48.528679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:48.528679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:48.566180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] MFA Rules not processed for user `bee3277080884574948a6f9ca8eaf56d`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:48.567485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:48.635046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:48.637776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:48.653133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362ca23-cdbf-42a0-94e2-832d345ed680 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:48.658351 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1040/2072] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:48.658851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:48.659747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:48.660027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:48.660300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] PATH_INFO: `/v3/users/f2d887cbc0874694934cb28a884bb4c5` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:48.661890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d887cbc0874694934cb28a884bb4c5)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:48.663792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:48.664067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:48.678373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69edb98-54d4-4219-99d7-7ffefde5a1a7 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:48.683144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:48.684101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:48.684357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:48.684684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:48.685451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:48.687514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:48.804677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1041/2073] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:48 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:48.808635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:48.872527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d887cbc0874694934cb28a884bb4c5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:48.873036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686afc0-5ede-4240-b8b5-bd625dcfd991 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:48.878919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:48.879698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:48.879986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:48.880261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:48.880956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:48.882881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:48.934878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d887cbc0874694934cb28a884bb4c5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:48.942567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d887cbc0874694934cb28a884bb4c5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:48.943219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d887cbc0874694934cb28a884bb4c5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:48.943860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d887cbc0874694934cb28a884bb4c5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:48.962407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1033/2074] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:48 2022] DELETE /identity/v3/users/f2d887cbc0874694934cb28a884bb4c5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:48.990956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1042/2075] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:48 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:48.994246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:48.998791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:49.065381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23828a29-e767-4285-bcc1-2b01f8866768 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.071100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.071901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.072249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.072595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.073404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.075077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:49.086214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1034/2076] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:49.090457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:49.100379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc130275-912f-4b2e-901e-c8ac26bf86f1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.105058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.105937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.106218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.106493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] PATH_INFO: `/v3/projects/d97c0b7d01d540719b05c286dc8282b3/users/28a8ae350f974f5a947913b8d2a8fb7d/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.121565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97c0b7d01d540719b05c286dc8282b3, user_id=28a8ae350f974f5a947913b8d2a8fb7d, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.124261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:49.221092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1043/2077] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:49 2022] PUT /identity/v3/projects/d97c0b7d01d540719b05c286dc8282b3/users/28a8ae350f974f5a947913b8d2a8fb7d/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:49.225058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:49.234862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8307c-bbe8-47f7-89d8-e355decccf46 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.253865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:49.255803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:49.298570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.304949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.304949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.304949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.304949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.304949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:49.311992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1035/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:49.316627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:49.326026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddad44-0114-4096-8dc8-9130c5320d13 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.331253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b25ef4-ab8f-44d2-a8cc-bd15f7610eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.331886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2112c-3de7-4c22-99ef-bc5684f7ab51 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.332147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b25ef4-ab8f-44d2-a8cc-bd15f7610eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.332428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b25ef4-ab8f-44d2-a8cc-bd15f7610eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.332704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b25ef4-ab8f-44d2-a8cc-bd15f7610eba admin admin] PATH_INFO: `/v3/projects/d97c0b7d01d540719b05c286dc8282b3/users/28a8ae350f974f5a947913b8d2a8fb7d/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.334627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b25ef4-ab8f-44d2-a8cc-bd15f7610eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97c0b7d01d540719b05c286dc8282b3, user_id=28a8ae350f974f5a947913b8d2a8fb7d, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.336871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.337290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b25ef4-ab8f-44d2-a8cc-bd15f7610eba admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:49.337728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.338017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.338321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] PATH_INFO: `/v3/projects/e2c0dee5894b4f6e8878469afd6b46fc` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.339625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c0dee5894b4f6e8878469afd6b46fc)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.341570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:49.347513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1036/2079] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:49 2022] PUT /identity/v3/projects/d97c0b7d01d540719b05c286dc8282b3/users/28a8ae350f974f5a947913b8d2a8fb7d/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:49.542178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c0dee5894b4f6e8878469afd6b46fc', 'request_id': 'req-a73446ea-f4db-43a3-b6fe-1a3d566dadac'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:49.548999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c0dee5894b4f6e8878469afd6b46fc', 'request_id': 'req-a73446ea-f4db-43a3-b6fe-1a3d566dadac'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:49.717834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c0dee5894b4f6e8878469afd6b46fc', 'request_id': 'req-a73446ea-f4db-43a3-b6fe-1a3d566dadac'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:49.730026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] The token cache is being invalidate because project e2c0dee5894b4f6e8878469afd6b46fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:49.730314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:49.731497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a73446ea-f4db-43a3-b6fe-1a3d566dadac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:49.733178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1044/2080] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:49 2022] DELETE /identity/v3/projects/e2c0dee5894b4f6e8878469afd6b46fc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:49.738750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.739224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.739302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.757947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:49.759187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:49.844983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1037/2081] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:49.852533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.852934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.853312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.873831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:49.875048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:49.887096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1045/2082] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:49.891748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:49.901685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f887aa3-d8ba-4877-a5ae-e01c45754b68 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.906498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.916457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.916457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.916457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.916457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:49.916457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.916457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:49.923389 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1038/2083] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:49.927895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:49.938560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7f429-11c0-41ec-bbd9-c3ebcfa4ab4e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:49.943642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:49.944321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:49.944616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:49.944879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:49.945644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:49.951297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:50.062541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1046/2084] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:49 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:50.063459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:50.073390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c489-196d-4eb5-b7c0-3cad48bad409 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:50.154320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:50.155303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.155893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.156527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.158110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:50.160532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:50.244864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1039/2085] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:50 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:50.246190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:50.258410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8a48-84d9-4834-92b1-581adffce48d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:50.263395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:50.264111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.264397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.264674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.265422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:50.267585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:50.280053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1047/2086] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:50.284529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:50.294786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397de2e-f7c3-43c6-97fe-ba86e65c85a6 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:50.304375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924f4f9-8519-45e6-bcc2-30ae667428d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:50.305052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f4f9-8519-45e6-bcc2-30ae667428d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.305384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f4f9-8519-45e6-bcc2-30ae667428d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.305668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924f4f9-8519-45e6-bcc2-30ae667428d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.306417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924f4f9-8519-45e6-bcc2-30ae667428d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:50.308135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924f4f9-8519-45e6-bcc2-30ae667428d9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:50.321966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1040/2087] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:50.323177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:50.334426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7b747-db63-494b-a6b2-59bf7ec0d0eb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:50.339397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:50.340316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.340595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.340866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] PATH_INFO: `/v3/projects/d0695fe13abc401a905fd0579770c1ad/users/b9282b0e5cbb458bb31d462a76832aa9/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.356104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0695fe13abc401a905fd0579770c1ad, user_id=b9282b0e5cbb458bb31d462a76832aa9, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:50.358784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:50.473799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1048/2088] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:50 2022] PUT /identity/v3/projects/d0695fe13abc401a905fd0579770c1ad/users/b9282b0e5cbb458bb31d462a76832aa9/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:50.474592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad2d5-91da-4228-876f-eb89d914ac19 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.474913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad2d5-91da-4228-876f-eb89d914ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.475194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad2d5-91da-4228-876f-eb89d914ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.497861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-93cad2d5-91da-4228-876f-eb89d914ac19 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:50.499122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-93cad2d5-91da-4228-876f-eb89d914ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:50.579309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1041/2089] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:50.588183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:50.589912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:50.671259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546205a6-c5ea-4b5d-a5c4-3d45aa52261a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:50.675751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:50.676046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.676447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.676819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.686418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:50.688666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:50.701452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1049/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:50.776285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.776820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.777796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:50.810651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] MFA Rules not processed for user `28a8ae350f974f5a947913b8d2a8fb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:50.812694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:50.901360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1042/2091] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:50.919993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:50.922140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:50.988020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea5eff-6d59-47f2-b23a-c055f398bbf7 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:50.995059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:50.995881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:50.996264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:50.996610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:51.001532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:51.066969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:51.068932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:51.079546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1050/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:52.894230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:52.907284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1d41a-ae01-4325-88ab-43fee0fc0e6a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:52.912468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f03387-80b9-4ab9-a371-5885cf0116c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:52.913789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f03387-80b9-4ab9-a371-5885cf0116c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:52.914261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f03387-80b9-4ab9-a371-5885cf0116c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:52.914542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f03387-80b9-4ab9-a371-5885cf0116c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:52.928805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f03387-80b9-4ab9-a371-5885cf0116c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:52.930260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f03387-80b9-4ab9-a371-5885cf0116c3 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:52.944861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1043/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:53.263358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:53.265022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:53.284440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b586f-83f2-411e-a2cb-82fede6d759d service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:53.289841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:53.290881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:53.291271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:53.291632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] PATH_INFO: `/v3/users/1efbff9cd62d4dee8d5b0fb1231a077c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:53.292942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1efbff9cd62d4dee8d5b0fb1231a077c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:53.295171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:53.515427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efbff9cd62d4dee8d5b0fb1231a077c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:53.594966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efbff9cd62d4dee8d5b0fb1231a077c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:53.602395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efbff9cd62d4dee8d5b0fb1231a077c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:53.607664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efbff9cd62d4dee8d5b0fb1231a077c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:53.617790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efbff9cd62d4dee8d5b0fb1231a077c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:53.624889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1051/2094] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:53 2022] DELETE /identity/v3/users/1efbff9cd62d4dee8d5b0fb1231a077c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:53.637575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:53.637575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:53.637575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:53.649912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:53.651125 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:53.718137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1044/2095] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:53.729200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:53.731467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:53.793647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2edc5-84b7-440f-9125-a0f523cc8cb7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:53.798969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:53.799699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:53.799987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:53.800263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:53.813751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:53.815761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:53.828292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1052/2096] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:54.458277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:54.459771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:54.480701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380481a1-c212-4532-8e0e-4920e78a9d70 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:54.490450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:54.492900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:54.495092 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:54.496203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] PATH_INFO: `/v3/projects/050ced58dcaf4eafbc8cd7373a84f7ad` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:54.508768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=050ced58dcaf4eafbc8cd7373a84f7ad)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:54.513350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:54.671131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050ced58dcaf4eafbc8cd7373a84f7ad', 'request_id': 'req-a936048f-0950-40e2-88f6-284c547cca1c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:54.679351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050ced58dcaf4eafbc8cd7373a84f7ad', 'request_id': 'req-a936048f-0950-40e2-88f6-284c547cca1c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:54.763364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050ced58dcaf4eafbc8cd7373a84f7ad', 'request_id': 'req-a936048f-0950-40e2-88f6-284c547cca1c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:54.776794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] The token cache is being invalidate because project 050ced58dcaf4eafbc8cd7373a84f7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:54.777239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:54.778013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:54.780408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1045/2097] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:54 2022] DELETE /identity/v3/projects/050ced58dcaf4eafbc8cd7373a84f7ad => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:54.784559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:54.795571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82237bf3-9585-4eb2-aad1-ba322c709a52 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:54.889211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:54.890127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:54.890470 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:54.890750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] PATH_INFO: `/v3/users/87640070f64942ee8f14f1862ac0992f` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:54.892350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87640070f64942ee8f14f1862ac0992f)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:54.894603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:55.097873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87640070f64942ee8f14f1862ac0992f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:55.194613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87640070f64942ee8f14f1862ac0992f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:55.207153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87640070f64942ee8f14f1862ac0992f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:55.207972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87640070f64942ee8f14f1862ac0992f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:55.221285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-995d02c0-f0a7-47c9-985a-f29e16828ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87640070f64942ee8f14f1862ac0992f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:55.250917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1053/2098] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:54 2022] DELETE /identity/v3/users/87640070f64942ee8f14f1862ac0992f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:55.841359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:55.842913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:55.858843 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936048f-0950-40e2-88f6-284c547cca1c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:55.939858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:55.941529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:55.942046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:55.942318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] PATH_INFO: `/v3/projects/98ebdc966fab489e92264a822c7f79de` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:55.943813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ebdc966fab489e92264a822c7f79de)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:55.945866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:56.127475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ebdc966fab489e92264a822c7f79de', 'request_id': 'req-f53e91d2-8023-48f4-a6bd-33e8d7064194'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:56.137179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ebdc966fab489e92264a822c7f79de', 'request_id': 'req-f53e91d2-8023-48f4-a6bd-33e8d7064194'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:56.228429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ebdc966fab489e92264a822c7f79de', 'request_id': 'req-f53e91d2-8023-48f4-a6bd-33e8d7064194'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:56.245335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] The token cache is being invalidate because project 98ebdc966fab489e92264a822c7f79de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:56.245703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:56.246678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f53e91d2-8023-48f4-a6bd-33e8d7064194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:56.248464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1046/2099] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:55 2022] DELETE /identity/v3/projects/98ebdc966fab489e92264a822c7f79de => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:56.254329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:56.254787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:56.255081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:56.275639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:56.276956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:56.395692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1054/2100] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:56.399270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:56.399726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:56.400116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:56.442608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:56.443875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:56.456064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1047/2101] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:56.460650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:56.474886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02f4e8-7f0b-4096-a49c-44057adbd848 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:56.482305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:56.483547 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:56.484128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:56.484666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:56.486475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:56.486980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:56.488860 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:56.505889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1055/2102] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:56.510565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:56.536772 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb828b34-588e-4b62-9db7-4f3d9e417c42 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:56.590107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50c2c-6d65-4079-ad40-b66d5919a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:56.592988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50c2c-6d65-4079-ad40-b66d5919a6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:56.593292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50c2c-6d65-4079-ad40-b66d5919a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:56.593576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50c2c-6d65-4079-ad40-b66d5919a6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:56.594851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50c2c-6d65-4079-ad40-b66d5919a6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:56.597807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50c2c-6d65-4079-ad40-b66d5919a6b1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:56.748274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1048/2103] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:56 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:56.752133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:56.830492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843aef4-de52-4d7f-a36b-90df1d43e270 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:56.925333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:56.925873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:56.926160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:56.926651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:56.927123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:56.929765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.027858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.028373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.028771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.043005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1056/2104] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:56 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:57.052440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:57.067639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208d053-d0b6-4ea7-8115-f3f4f9f48235 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:57.070219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] MFA Rules not processed for user `b9282b0e5cbb458bb31d462a76832aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:57.071411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:57.072582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:57.073243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.073527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.073803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.074532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:57.076158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.087082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1057/2105] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:57.091154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:57.101404 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6d019-3271-4ea7-b555-0ffcf5e91885 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:57.106051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:57.106704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.106988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.107274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.108168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:57.113032 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.121466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1058/2106] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:57.127296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:57.155591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8e374-f8a4-444c-b572-bcbd2125b0f2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:57.176764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b9d3b-c26d-45de-aff3-b40b6f434d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:57.178339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b9d3b-c26d-45de-aff3-b40b6f434d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.178743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b9d3b-c26d-45de-aff3-b40b6f434d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.179384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b9d3b-c26d-45de-aff3-b40b6f434d3b admin admin] PATH_INFO: `/v3/projects/77dcd685ef504366a129fca8ccaf38d7/users/18203c3c84d84b269e0a9378d14091a6/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.182071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1049/2107] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:57.200263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:57.201903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:57.205131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b9d3b-c26d-45de-aff3-b40b6f434d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dcd685ef504366a129fca8ccaf38d7, user_id=18203c3c84d84b269e0a9378d14091a6, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:57.208187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b9d3b-c26d-45de-aff3-b40b6f434d3b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.334827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1059/2108] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:50:57 2022] PUT /identity/v3/projects/77dcd685ef504366a129fca8ccaf38d7/users/18203c3c84d84b269e0a9378d14091a6/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:50:57.350233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.351209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.352170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.352520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfb695-9e2d-4aa7-acad-1f4784e51b6c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:57.392573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] MFA Rules not processed for user `18203c3c84d84b269e0a9378d14091a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:57.393871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:57.448906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:57.450134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.450415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.450956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.502999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1060/2109] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:50:57.512160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:57.514497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:57.577108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:57.579393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.592363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1050/2110] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:50:57.597581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50c3c4-6a49-403a-862d-f9770c124759 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:57.601292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc57ba6-f3f0-48f5-aeca-d4462064a5aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:57.601941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57ba6-f3f0-48f5-aeca-d4462064a5aa service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.602219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57ba6-f3f0-48f5-aeca-d4462064a5aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.602492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc57ba6-f3f0-48f5-aeca-d4462064a5aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.611192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57ba6-f3f0-48f5-aeca-d4462064a5aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:57.612660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc57ba6-f3f0-48f5-aeca-d4462064a5aa service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.621589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1061/2111] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:57.640789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:57.711204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc03ceb-9fd8-408b-8212-8ab9914a360b service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:57.716003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:57.717225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:57.717579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:57.717933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] PATH_INFO: `/v3/users/18203c3c84d84b269e0a9378d14091a6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:57.719937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18203c3c84d84b269e0a9378d14091a6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:57.722477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:57.907573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18203c3c84d84b269e0a9378d14091a6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:58.045670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18203c3c84d84b269e0a9378d14091a6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:58.054121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18203c3c84d84b269e0a9378d14091a6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:58.055309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18203c3c84d84b269e0a9378d14091a6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:58.056138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18203c3c84d84b269e0a9378d14091a6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:58.076587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1051/2112] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:50:57 2022] DELETE /identity/v3/users/18203c3c84d84b269e0a9378d14091a6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:58.081892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663887b-3aec-478c-bb71-3117d639078f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:58.082184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663887b-3aec-478c-bb71-3117d639078f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:58.082463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663887b-3aec-478c-bb71-3117d639078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:58.100774 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a663887b-3aec-478c-bb71-3117d639078f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:58.101990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a663887b-3aec-478c-bb71-3117d639078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:58.162152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1062/2113] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:58.172456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:58.174107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:58.283800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff517a-3c4b-420c-8653-44df79d23b1c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:58.288138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6583-9d84-4727-a15b-848f6a0b0e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:58.288733 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6583-9d84-4727-a15b-848f6a0b0e82 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:58.289058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6583-9d84-4727-a15b-848f6a0b0e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:58.289298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6583-9d84-4727-a15b-848f6a0b0e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:58.302237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e6583-9d84-4727-a15b-848f6a0b0e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:58.303784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e6583-9d84-4727-a15b-848f6a0b0e82 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:58.320019 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1052/2114] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:50:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:50:58.974389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663887b-3aec-478c-bb71-3117d639078f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:58.976925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a663887b-3aec-478c-bb71-3117d639078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:59.010910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663887b-3aec-478c-bb71-3117d639078f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:59.024503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:59.025398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.025685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.025966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] PATH_INFO: `/v3/projects/77dcd685ef504366a129fca8ccaf38d7` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.028383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77dcd685ef504366a129fca8ccaf38d7)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:59.030426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:59.185767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77dcd685ef504366a129fca8ccaf38d7', 'request_id': 'req-2738b767-db63-4718-ad3e-e1e535add85c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:59.192777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77dcd685ef504366a129fca8ccaf38d7', 'request_id': 'req-2738b767-db63-4718-ad3e-e1e535add85c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:59.279956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77dcd685ef504366a129fca8ccaf38d7', 'request_id': 'req-2738b767-db63-4718-ad3e-e1e535add85c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:59.296349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] The token cache is being invalidate because project 77dcd685ef504366a129fca8ccaf38d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:50:59.296756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:59.297478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2738b767-db63-4718-ad3e-e1e535add85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:50:59.299097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1063/2115] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:50:58 2022] DELETE /identity/v3/projects/77dcd685ef504366a129fca8ccaf38d7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:50:59.304291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.305180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.305530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.356129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:59.357539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:59.437521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1053/2116] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:59.447045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.447677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.448137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.472118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:50:59.473837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:50:59.483407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1064/2117] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:50:59.488344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:59.500336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d386a-7d62-4062-80ab-393f35f05733 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:59.509485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:59.510190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.510502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.510779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.511621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:50:59.512000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:59.513718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:59.527030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1054/2118] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:50:59.532030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:59.543505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c77198-0310-46c7-b042-efc578d9cf31 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:59.549244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:59.550016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.550369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.550712 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.551544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:59.554053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:59.685577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1065/2119] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:50:59 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:50:59.687351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:59.701291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30241-646c-4c8e-8753-dc14dac37259 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:59.771098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:59.772256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.772864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.773728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.774551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:59.776828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:59.914796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1055/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:50:59 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:50:59.919067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:50:59.940604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f8973-9a5d-4c7a-91ae-c762182e276e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:50:59.950970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:50:59.952646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:50:59.953343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:50:59.959998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:50:59.961002 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:50:59.964633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:50:59.978375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1066/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:50:59.982866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:00.019311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08855322-bbc9-483c-8dd7-adc7b358fab0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:00.037622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace351f-1b6a-4dad-97c6-c6d9892df3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:00.038321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace351f-1b6a-4dad-97c6-c6d9892df3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.038610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace351f-1b6a-4dad-97c6-c6d9892df3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.038889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace351f-1b6a-4dad-97c6-c6d9892df3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.039729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace351f-1b6a-4dad-97c6-c6d9892df3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:00.041405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace351f-1b6a-4dad-97c6-c6d9892df3b8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:00.070138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1056/2122] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:00.072110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:00.083193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e484f-ada7-411b-9873-b4d73bf121db admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:00.109204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:00.111371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.111969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.112429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] PATH_INFO: `/v3/projects/8ad8f15010994e60b4b12fb8df4567c2/users/f95bc6d4ebde41e6b9b8eafc0c374367/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.134643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad8f15010994e60b4b12fb8df4567c2, user_id=f95bc6d4ebde41e6b9b8eafc0c374367, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:00.139047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:00.219838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1067/2123] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:00 2022] PUT /identity/v3/projects/8ad8f15010994e60b4b12fb8df4567c2/users/f95bc6d4ebde41e6b9b8eafc0c374367/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:00.233030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.233325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.233608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.319854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] MFA Rules not processed for user `f95bc6d4ebde41e6b9b8eafc0c374367`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:00.319854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:00.404334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1057/2124] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:00.408930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:00.507180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de87997-fbc8-426c-805b-f2eda1f74081 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:00.513907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:00.514666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.514958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.515259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.516018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:00.518936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:00.606732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1068/2125] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:00 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:00.611539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:00.622794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c03dd-bbb6-4c95-bc13-8b235bbc34f9 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:00.696518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdae59-def6-4514-a999-cd38042f0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:00.697219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdae59-def6-4514-a999-cd38042f0af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.697490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdae59-def6-4514-a999-cd38042f0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.697765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdae59-def6-4514-a999-cd38042f0af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.698464 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdae59-def6-4514-a999-cd38042f0af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:00.700622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdae59-def6-4514-a999-cd38042f0af8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:00.796690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1058/2126] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:00 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:00.798854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:00.799921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.800284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.800684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.811450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e875b3d-4ee7-4978-bd39-07f165ad7504 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:00.818588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:00.818797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.819191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.819540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.820598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:00.822397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:00.823041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] MFA Rules not processed for user `b9282b0e5cbb458bb31d462a76832aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:00.824439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:00.836107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1069/2127] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:00.842183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:00.853858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf92759-72f3-4fcf-858b-afc90f806b3e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:00.859022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:00.859943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:00.860367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:00.861337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] PATH_INFO: `/v3/projects/2d331a2da54345cb897dd41bfe4769f4/users/b5f04acdc2d0466ba671d89145846f8e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:00.883120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d331a2da54345cb897dd41bfe4769f4, user_id=b5f04acdc2d0466ba671d89145846f8e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:00.888407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:00.917196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1059/2128] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:51:00.992457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1070/2129] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:00 2022] PUT /identity/v3/projects/2d331a2da54345cb897dd41bfe4769f4/users/b5f04acdc2d0466ba671d89145846f8e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:00.996555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:01.011337 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8070cf-c7f6-4028-927b-500d8ea1ad01 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:01.089208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5d017-17be-424d-9296-45d1544235c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:01.089885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d017-17be-424d-9296-45d1544235c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:01.090164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d017-17be-424d-9296-45d1544235c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:01.090438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5d017-17be-424d-9296-45d1544235c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:01.091350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d017-17be-424d-9296-45d1544235c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:01.093065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5d017-17be-424d-9296-45d1544235c7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:01.108289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1060/2130] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:01.109124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:01.140718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af5f39-e3a9-4513-98c0-df9ffb95e15f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:01.148459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:01.149352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:01.149781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:01.150221 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] PATH_INFO: `/v3/projects/2d331a2da54345cb897dd41bfe4769f4/users/b5f04acdc2d0466ba671d89145846f8e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:01.153061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d331a2da54345cb897dd41bfe4769f4, user_id=b5f04acdc2d0466ba671d89145846f8e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:01.156476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:01.175591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1071/2131] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:01 2022] PUT /identity/v3/projects/2d331a2da54345cb897dd41bfe4769f4/users/b5f04acdc2d0466ba671d89145846f8e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:01.187692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:01.188041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:01.188387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:01.229330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] MFA Rules not processed for user `b5f04acdc2d0466ba671d89145846f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:01.230947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:01.341477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1061/2132] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:01.353513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:01.355232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:01.447956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150fbb3-d205-4b6b-b083-6f43fbcec5b6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:01.451950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4951-44e4-4dde-85ad-ddfe9ea12ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:01.452706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4951-44e4-4dde-85ad-ddfe9ea12ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:01.453046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4951-44e4-4dde-85ad-ddfe9ea12ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:01.453428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4951-44e4-4dde-85ad-ddfe9ea12ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:01.534029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4951-44e4-4dde-85ad-ddfe9ea12ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:01.535653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4951-44e4-4dde-85ad-ddfe9ea12ee6 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:01.547775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1072/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:02.476801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:02.483765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:02.546356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62068c-def2-4970-84a2-9a6e23374af7 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:02.551945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:02.554425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:02.554722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:02.556528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] PATH_INFO: `/v3/users/14db42a54c7a499e9b424a410b01b478` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:02.557250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14db42a54c7a499e9b424a410b01b478)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:02.559193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:02.745356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14db42a54c7a499e9b424a410b01b478'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:02.828313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14db42a54c7a499e9b424a410b01b478'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:02.837467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14db42a54c7a499e9b424a410b01b478'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:02.838246 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14db42a54c7a499e9b424a410b01b478'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:02.838969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14db42a54c7a499e9b424a410b01b478'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:02.857644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1062/2134] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:02 2022] DELETE /identity/v3/users/14db42a54c7a499e9b424a410b01b478 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:02.862346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:02.862796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:02.862884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:02.890966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:02.893043 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:02.973478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1073/2135] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:02.975976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:02.977833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:03.059794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fcd60-5f7b-4b73-a857-40e19337bf16 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:03.063906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da287985-4b89-4430-8f62-837ae9df1503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:03.064552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287985-4b89-4430-8f62-837ae9df1503 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:03.064839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287985-4b89-4430-8f62-837ae9df1503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:03.065115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da287985-4b89-4430-8f62-837ae9df1503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:03.077432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da287985-4b89-4430-8f62-837ae9df1503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:03.078887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da287985-4b89-4430-8f62-837ae9df1503 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:03.097421 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1063/2136] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:03.573148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:03.574871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:03.597466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de81bf-6633-4c47-8132-6547c5bbc0e3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:03.602393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:03.603276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:03.603678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:03.603869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] PATH_INFO: `/v3/projects/0ec724d38c4048058eee37b9a405f907` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:03.605103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec724d38c4048058eee37b9a405f907)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:03.606976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:03.760235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec724d38c4048058eee37b9a405f907', 'request_id': 'req-4f62ae82-e787-467c-83e2-64a3ebabe5c7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:03.766150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec724d38c4048058eee37b9a405f907', 'request_id': 'req-4f62ae82-e787-467c-83e2-64a3ebabe5c7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:03.839331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec724d38c4048058eee37b9a405f907', 'request_id': 'req-4f62ae82-e787-467c-83e2-64a3ebabe5c7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:03.850832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] The token cache is being invalidate because project 0ec724d38c4048058eee37b9a405f907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:03.851114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:03.851761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4f62ae82-e787-467c-83e2-64a3ebabe5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:03.853292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1074/2137] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:03 2022] DELETE /identity/v3/projects/0ec724d38c4048058eee37b9a405f907 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:03.858226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:03.858703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:03.858793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:03.897884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:03.902695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:03.956946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1064/2138] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:03.965021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:03.972044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:03.972334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.000407 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:04.001704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:04.010490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1075/2139] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:04.014692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.025658 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9c646-433d-4f34-9caf-21598fe257f0 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.030825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.031490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.031801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.032077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.033351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:51:04.033656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.035295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.048030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1065/2140] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:51:04.052527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.061967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a4f5c-e8a2-4c45-8bc1-ef40f1234655 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.067321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.068014 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.068297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.068596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.069448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.071344 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.201947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1076/2141] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:04 2022] POST /identity/v3/projects => generated 397 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:04.205065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.214755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0dd2a-9a34-4c23-acc2-c1b64d182256 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.278440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.279262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.279678 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.279959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.280673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.283219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.405544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1066/2142] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:04 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:04.410060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.423317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.424426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fa01b-e7b2-4bce-840e-2960c4ec4ef1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.425331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:04.434679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.435689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.437005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.437569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.438440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1c44a-200a-4af9-91f5-c167f739604a admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.438910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.442210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.444415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.445443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.445774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.446118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] PATH_INFO: `/v3/users/a61d16e2f72346b6aa5c55a652fe2cb6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.447424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a61d16e2f72346b6aa5c55a652fe2cb6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.450008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.460110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1077/2143] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:04.463692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.477223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dab0e9-eb41-4d0f-9787-fb8b96f39aa1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.482451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.483111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.488291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.488291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.488291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.488291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.498770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1078/2144] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:04.502598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.512424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fa3a-3744-421d-82ab-b8e67864a5f0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.517572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4364-193a-4ea0-bf8a-0bb86416b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.518552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4364-193a-4ea0-bf8a-0bb86416b809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.518834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4364-193a-4ea0-bf8a-0bb86416b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.519111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4364-193a-4ea0-bf8a-0bb86416b809 admin admin] PATH_INFO: `/v3/projects/274064aa1be143559ae63e2887665f3e/users/c42b412ba1974d89b6eaf03646e69794/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.534738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c4364-193a-4ea0-bf8a-0bb86416b809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274064aa1be143559ae63e2887665f3e, user_id=c42b412ba1974d89b6eaf03646e69794, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:04.537708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c4364-193a-4ea0-bf8a-0bb86416b809 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:04.652453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1079/2145] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:04 2022] PUT /identity/v3/projects/274064aa1be143559ae63e2887665f3e/users/c42b412ba1974d89b6eaf03646e69794/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:04.664255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.664255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.664458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.710356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] MFA Rules not processed for user `c42b412ba1974d89b6eaf03646e69794`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:04.711640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:04.745086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a61d16e2f72346b6aa5c55a652fe2cb6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:04.832132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1080/2146] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:04.833648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.835670 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:04.840489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a61d16e2f72346b6aa5c55a652fe2cb6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:04.850501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a61d16e2f72346b6aa5c55a652fe2cb6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:04.851439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a61d16e2f72346b6aa5c55a652fe2cb6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:04.852224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a61d16e2f72346b6aa5c55a652fe2cb6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:04.881012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1067/2147] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:04 2022] DELETE /identity/v3/users/a61d16e2f72346b6aa5c55a652fe2cb6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:04.883126 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:04.884952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:04.934777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1ed5-5562-45d3-994f-b7274f6a96fe None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.963855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c924dc-2fd7-4329-9d4a-1567b0bab268 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:04.967548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:04.977517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:04.977517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:04.977517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:04.980854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:05.038102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:05.040644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:05.040958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:05.041391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] PATH_INFO: `/v3/users/f95bc6d4ebde41e6b9b8eafc0c374367` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:05.042580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95bc6d4ebde41e6b9b8eafc0c374367)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:05.044653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:05.052047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:05.053491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51247fda-da88-4ea8-88fc-163123700057 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:05.062543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1068/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:05.063857 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:05.064178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:05.064457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:05.082800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:05.084101 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:05.103910 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1069/2149] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:05.115708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:05.117742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:05.218789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f671cd1-6c05-42a8-b84c-1f3901a64c1e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:05.223700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76309ed-71ff-4bf6-a5cc-fc1f4d01a0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:05.224513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76309ed-71ff-4bf6-a5cc-fc1f4d01a0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:05.224799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76309ed-71ff-4bf6-a5cc-fc1f4d01a0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:05.225108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76309ed-71ff-4bf6-a5cc-fc1f4d01a0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:05.238213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76309ed-71ff-4bf6-a5cc-fc1f4d01a0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:05.240231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76309ed-71ff-4bf6-a5cc-fc1f4d01a0fe service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:05.248322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95bc6d4ebde41e6b9b8eafc0c374367'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:05.256617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1070/2150] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:51:05.371542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95bc6d4ebde41e6b9b8eafc0c374367'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:05.384922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95bc6d4ebde41e6b9b8eafc0c374367'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:05.385926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95bc6d4ebde41e6b9b8eafc0c374367'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:05.412077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95bc6d4ebde41e6b9b8eafc0c374367'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:05.429193 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1081/2151] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:04 2022] DELETE /identity/v3/users/f95bc6d4ebde41e6b9b8eafc0c374367 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:05.433627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:05.433994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:05.434343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:05.469626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:05.471119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:05.587954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1071/2152] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:05.606090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:05.608936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:05.764913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47e4b6-d662-43eb-b906-79ac766b1779 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:05.764913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:05.764913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:05.764913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:05.765489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:05.765489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:05.765489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:05.765489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1082/2153] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:06.819077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:06.821074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:06.846588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba71883-5667-4af3-bae0-f022c7fb5389 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:06.852267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:06.853902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:06.854388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:06.854855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] PATH_INFO: `/v3/projects/23ff4d9fc6654180a6a1338cbf6d48e1` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:06.856930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ff4d9fc6654180a6a1338cbf6d48e1)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:06.861432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:06.963365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:06.967589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:06.995024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df0f16-b7a8-4afc-95a4-8b44ce08c04e service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.002458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.003721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.004015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.004342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] PATH_INFO: `/v3/projects/8ad8f15010994e60b4b12fb8df4567c2` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.005611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad8f15010994e60b4b12fb8df4567c2)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.007592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.047403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ff4d9fc6654180a6a1338cbf6d48e1', 'request_id': 'req-84f46212-8de6-464c-9918-6fa387e4f717'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.053721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ff4d9fc6654180a6a1338cbf6d48e1', 'request_id': 'req-84f46212-8de6-464c-9918-6fa387e4f717'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.124871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad8f15010994e60b4b12fb8df4567c2', 'request_id': 'req-1a1cb382-16dd-494f-b13e-808bbc21a880'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.131485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad8f15010994e60b4b12fb8df4567c2', 'request_id': 'req-1a1cb382-16dd-494f-b13e-808bbc21a880'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.180483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ff4d9fc6654180a6a1338cbf6d48e1', 'request_id': 'req-84f46212-8de6-464c-9918-6fa387e4f717'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.193620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] The token cache is being invalidate because project 23ff4d9fc6654180a6a1338cbf6d48e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:07.193911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.194564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-84f46212-8de6-464c-9918-6fa387e4f717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.196160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1072/2154] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:06 2022] DELETE /identity/v3/projects/23ff4d9fc6654180a6a1338cbf6d48e1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:07.201062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd2b53-1447-4837-b9fe-fb1f46a811df None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.201352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd2b53-1447-4837-b9fe-fb1f46a811df None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.201638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd2b53-1447-4837-b9fe-fb1f46a811df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.222951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-eefd2b53-1447-4837-b9fe-fb1f46a811df None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:07.224296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-eefd2b53-1447-4837-b9fe-fb1f46a811df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:07.261931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad8f15010994e60b4b12fb8df4567c2', 'request_id': 'req-1a1cb382-16dd-494f-b13e-808bbc21a880'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.274026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] The token cache is being invalidate because project 8ad8f15010994e60b4b12fb8df4567c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:07.274314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.275160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.276820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1083/2155] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:06 2022] DELETE /identity/v3/projects/8ad8f15010994e60b4b12fb8df4567c2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:07.281001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.283249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:07.299207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1073/2156] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:51:07.300924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.301211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.301495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.302568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb382-16dd-494f-b13e-808bbc21a880 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.313481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.314462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.314744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.315018 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] PATH_INFO: `/v3/users/b5f04acdc2d0466ba671d89145846f8e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.316363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f04acdc2d0466ba671d89145846f8e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.326068 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.331735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:07.333205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:07.344609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1074/2157] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:07.349411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.360396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473f76c-724c-4c2e-b75e-8ca87fd58341 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.365296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.365954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.366291 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.366566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.367300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:51:07.367610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.369413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.381682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1075/2158] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:51:07.385911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.397245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943d4a0-c247-465b-8be6-c968f9dab224 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.402610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.403460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.403760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.404151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.404960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.406941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.494634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f04acdc2d0466ba671d89145846f8e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.544328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1076/2159] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:07 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:51:07.549863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.607574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f04acdc2d0466ba671d89145846f8e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.609811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b2b48-fec0-44b9-97f1-3a1b104c99f7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.613592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f04acdc2d0466ba671d89145846f8e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.614472 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f04acdc2d0466ba671d89145846f8e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.615482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.616712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.616712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.616712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.617617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.619473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.628499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f04acdc2d0466ba671d89145846f8e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:07.634705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1084/2160] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:07 2022] DELETE /identity/v3/users/b5f04acdc2d0466ba671d89145846f8e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:07.724790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1077/2161] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:07 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:51:07.726037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.730410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:07.817022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f143436-e75c-4895-b56d-c9980fbf6e74 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.824977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.825672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.825959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.826241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.827145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.828876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.852747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1085/2162] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:07.856846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.869416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cbcae-e085-4ec0-b6bd-9878e4e4ccad admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.875586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37ed4-f889-44db-8dcb-275161cdf78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.876290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37ed4-f889-44db-8dcb-275161cdf78e admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.876608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37ed4-f889-44db-8dcb-275161cdf78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.876886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37ed4-f889-44db-8dcb-275161cdf78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.877631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37ed4-f889-44db-8dcb-275161cdf78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.880022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37ed4-f889-44db-8dcb-275161cdf78e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:07.896144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1078/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:07.897367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:07.908974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6b54-30a2-4ce5-8f11-78e269e7fe9e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:07.917137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:07.918124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:07.918496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:07.918844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] PATH_INFO: `/v3/projects/dab3317553d1476a8a034b78dc5572b2/users/b578cbaa1cb247859e9eed23dc131734/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:07.942573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab3317553d1476a8a034b78dc5572b2, user_id=b578cbaa1cb247859e9eed23dc131734, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:07.946830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.116128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1086/2164] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:07 2022] PUT /identity/v3/projects/dab3317553d1476a8a034b78dc5572b2/users/b578cbaa1cb247859e9eed23dc131734/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:08.120115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.120479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.120952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.139867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:08.141274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:08.206745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1079/2165] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:08.215912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.217897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:08.221241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.222743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:08.235550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047a64c-053b-48c2-8f26-bb112aa2ee19 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.240962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.241842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.242170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.242430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] PATH_INFO: `/v3/projects/2d331a2da54345cb897dd41bfe4769f4` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.243687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d331a2da54345cb897dd41bfe4769f4)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.245628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.276758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33224978-69a6-4bbb-b5c5-78d5c204c134 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.282020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87249841-0560-4e86-860f-91515ca99ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.283529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249841-0560-4e86-860f-91515ca99ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.283720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249841-0560-4e86-860f-91515ca99ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.283997 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87249841-0560-4e86-860f-91515ca99ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.293349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249841-0560-4e86-860f-91515ca99ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.294772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87249841-0560-4e86-860f-91515ca99ff4 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.304044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1087/2166] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:51:08.348342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d331a2da54345cb897dd41bfe4769f4', 'request_id': 'req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:08.353528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d331a2da54345cb897dd41bfe4769f4', 'request_id': 'req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:08.439546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d331a2da54345cb897dd41bfe4769f4', 'request_id': 'req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:08.450911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] The token cache is being invalidate because project 2d331a2da54345cb897dd41bfe4769f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:08.451202 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:08.451899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4ee8a8ef-55bb-47e6-9abe-1a12cdd8927b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:08.453538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1080/2167] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:08 2022] DELETE /identity/v3/projects/2d331a2da54345cb897dd41bfe4769f4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:08.459962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.460194 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.460466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.478548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:08.479786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:08.539021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1088/2168] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:08.547009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880351-4a43-4204-bf57-51778f2f740f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.547361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880351-4a43-4204-bf57-51778f2f740f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.547662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880351-4a43-4204-bf57-51778f2f740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.566318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-88880351-4a43-4204-bf57-51778f2f740f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:08.567568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-88880351-4a43-4204-bf57-51778f2f740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:08.575400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1081/2169] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:08.579809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.589555 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5351-63ac-44bb-990d-2d57fcc1650d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.594033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.594665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.594944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.595262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.596520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:51:08.596845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.598457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.613942 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1089/2170] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:51:08.615022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880351-4a43-4204-bf57-51778f2f740f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.624278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880351-4a43-4204-bf57-51778f2f740f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.629082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.629734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.630018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.630298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.630997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.633063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.727155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1082/2171] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:08 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:51:08.731276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.742275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eacc6-f6a0-4d57-ade4-4792c3d42a01 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.798250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.798911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.799827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.800101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.800826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.802742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.887440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1090/2172] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:08 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:08.891839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.903041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5c9c1-789b-4422-a46e-7e85820dd5b9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.907960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.909186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.913597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.913597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.913597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.913597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.923211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1083/2173] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:51:08.927170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.937111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751838ae-d0f8-45e4-ac39-8589eb84f031 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.941793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56e9a-913d-4420-aa03-b6b4f3beae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.942432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56e9a-913d-4420-aa03-b6b4f3beae83 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.942709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56e9a-913d-4420-aa03-b6b4f3beae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.942980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56e9a-913d-4420-aa03-b6b4f3beae83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.943748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56e9a-913d-4420-aa03-b6b4f3beae83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.945327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b56e9a-913d-4420-aa03-b6b4f3beae83 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:08.957799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1091/2174] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:08.961900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:08.972863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045789c2-1a3a-4d48-ba2e-df9b7e140291 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:08.977868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:08.978826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:08.979113 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:08.979387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] PATH_INFO: `/v3/projects/6813817e039a42be9b0d434d1f800234/users/4114acc6b31d434e933b85224fb87cd5/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:08.994833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6813817e039a42be9b0d434d1f800234, user_id=4114acc6b31d434e933b85224fb87cd5, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:08.997548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:09.066515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1084/2175] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:08 2022] PUT /identity/v3/projects/6813817e039a42be9b0d434d1f800234/users/4114acc6b31d434e933b85224fb87cd5/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:09.073674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b63d4-2997-45d5-a08b-f2df2bb57ff6 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:09.074353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b63d4-2997-45d5-a08b-f2df2bb57ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:09.074353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b63d4-2997-45d5-a08b-f2df2bb57ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:09.117428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-df3b63d4-2997-45d5-a08b-f2df2bb57ff6 None None] MFA Rules not processed for user `4114acc6b31d434e933b85224fb87cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:09.118773 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-df3b63d4-2997-45d5-a08b-f2df2bb57ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:09.184441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1092/2176] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:09.196035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:09.197801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:09.260223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355b766-9519-4b9b-9a51-1aea8a534358 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:09.264174 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:09.264823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:09.265109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:09.265396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:09.277617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:09.279157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:09.288923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1085/2177] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:09.550491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373714-0df2-4526-9051-655555bf3006 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:09.550864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373714-0df2-4526-9051-655555bf3006 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:09.551175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18373714-0df2-4526-9051-655555bf3006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:09.579098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-18373714-0df2-4526-9051-655555bf3006 None None] MFA Rules not processed for user `b578cbaa1cb247859e9eed23dc131734`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:09.580558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-18373714-0df2-4526-9051-655555bf3006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:09.645887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1093/2178] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:09.656506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:09.657893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:09.669296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392e33-2b41-4d52-995d-5276e062df27 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:09.673238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:09.673859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:09.674666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:09.674938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:09.684080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:09.685510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:09.695846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1086/2179] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:12.462631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86a66-12a2-486e-9529-49b4fe30800e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:12.463099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86a66-12a2-486e-9529-49b4fe30800e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:12.463526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a86a66-12a2-486e-9529-49b4fe30800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:12.483484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-77a86a66-12a2-486e-9529-49b4fe30800e None None] MFA Rules not processed for user `b578cbaa1cb247859e9eed23dc131734`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:12.485510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-77a86a66-12a2-486e-9529-49b4fe30800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:12.499365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1094/2180] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:13.349386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:13.457395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d572e-16a5-4c9a-ad4a-38aa09c8c4e2 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:13.464258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:13.468504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:13.468504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:13.468504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] PATH_INFO: `/v3/users/4114acc6b31d434e933b85224fb87cd5` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:13.468504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4114acc6b31d434e933b85224fb87cd5)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:13.469057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:13.753151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4114acc6b31d434e933b85224fb87cd5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:13.873883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4114acc6b31d434e933b85224fb87cd5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:13.884458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4114acc6b31d434e933b85224fb87cd5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:13.885472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4114acc6b31d434e933b85224fb87cd5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:13.885804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4114acc6b31d434e933b85224fb87cd5'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:13.906265 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1087/2181] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:13 2022] DELETE /identity/v3/users/4114acc6b31d434e933b85224fb87cd5 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:13.910627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:13.911441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:13.911678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:13.930568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:13.931937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:13.994574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1095/2182] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:14.009298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:14.010867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:14.085203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc303cd-6257-401f-82f4-3084fe3816c7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:14.088963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:14.089652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:14.089931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:14.090205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:14.099869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:14.101344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:14.110929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1088/2183] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:14.673640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:14.675673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:14.687433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589c8bd-2483-4bd9-b8b0-7b3c873254cd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:14.693073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:14.694236 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:14.694879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:14.695300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] PATH_INFO: `/v3/projects/6813817e039a42be9b0d434d1f800234` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:14.706908 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6813817e039a42be9b0d434d1f800234)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:14.708892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:14.826448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6813817e039a42be9b0d434d1f800234', 'request_id': 'req-70716744-174b-4dfe-80eb-3c4a3e2e79e6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:14.832313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6813817e039a42be9b0d434d1f800234', 'request_id': 'req-70716744-174b-4dfe-80eb-3c4a3e2e79e6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:14.859175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:14.860604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:14.873378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987025-b059-4bc4-af29-9191a2aa5f4e service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:14.935797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6813817e039a42be9b0d434d1f800234', 'request_id': 'req-70716744-174b-4dfe-80eb-3c4a3e2e79e6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:14.947864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:14.949971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:14.950599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:14.950979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] PATH_INFO: `/v3/users/c42b412ba1974d89b6eaf03646e69794` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:14.954143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42b412ba1974d89b6eaf03646e69794)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:14.956649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] The token cache is being invalidate because project 6813817e039a42be9b0d434d1f800234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:14.956948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:14.957064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:14.958268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-70716744-174b-4dfe-80eb-3c4a3e2e79e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:14.961889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1096/2184] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:14 2022] DELETE /identity/v3/projects/6813817e039a42be9b0d434d1f800234 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:15.202238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42b412ba1974d89b6eaf03646e69794'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:15.274257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42b412ba1974d89b6eaf03646e69794'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:15.287481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42b412ba1974d89b6eaf03646e69794'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:15.288326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42b412ba1974d89b6eaf03646e69794'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:15.288933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42b412ba1974d89b6eaf03646e69794'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:15.326758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1089/2185] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:14 2022] DELETE /identity/v3/users/c42b412ba1974d89b6eaf03646e69794 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:15.328569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:15.328859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:15.329141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:15.356559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:15.358168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:15.424970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1097/2186] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:15.436204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:15.437866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:15.521406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fb282-9f6a-4020-a9e4-69ed3ec90c6c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:15.527840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:15.532434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:15.532873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:15.538709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:15.545065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:15.546801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:15.558767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1090/2187] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:16.027698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:16.029215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:16.043576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a35b5e-c644-4356-8aa6-8e6f4af890c3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:16.050215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:16.051283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:16.051754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:16.052205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] PATH_INFO: `/v3/projects/274064aa1be143559ae63e2887665f3e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:16.053918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] RBAC: Authorizing `identity:delete_project(project_id=274064aa1be143559ae63e2887665f3e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:16.056122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:16.256059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274064aa1be143559ae63e2887665f3e', 'request_id': 'req-6b02a4a1-49cf-42c5-a3cc-434bff07826f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.260951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274064aa1be143559ae63e2887665f3e', 'request_id': 'req-6b02a4a1-49cf-42c5-a3cc-434bff07826f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.321288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:16.322693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:16.336151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ed6d-756f-4e97-a70a-d7234d8035b0 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:16.399718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274064aa1be143559ae63e2887665f3e', 'request_id': 'req-6b02a4a1-49cf-42c5-a3cc-434bff07826f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.409924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:16.411493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:16.412031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:16.412496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] PATH_INFO: `/v3/users/bee3277080884574948a6f9ca8eaf56d` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:16.414560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee3277080884574948a6f9ca8eaf56d)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:16.416285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] The token cache is being invalidate because project 274064aa1be143559ae63e2887665f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:16.416772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.417419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:16.418098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.427180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1098/2188] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:16 2022] DELETE /identity/v3/projects/274064aa1be143559ae63e2887665f3e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:16.670493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee3277080884574948a6f9ca8eaf56d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.733888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee3277080884574948a6f9ca8eaf56d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.757329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee3277080884574948a6f9ca8eaf56d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.758105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee3277080884574948a6f9ca8eaf56d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.758809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee3277080884574948a6f9ca8eaf56d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:16.784035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1091/2189] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:16 2022] DELETE /identity/v3/users/bee3277080884574948a6f9ca8eaf56d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:51:17.060473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:17.062514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:17.085599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02a4a1-49cf-42c5-a3cc-434bff07826f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:17.150501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:17.151536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:17.151872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:17.152145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] PATH_INFO: `/v3/projects/50c4bf98965441678e2181db5293f64a` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:17.153451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c4bf98965441678e2181db5293f64a)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:17.155362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:17.267938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c4bf98965441678e2181db5293f64a', 'request_id': 'req-07163458-8161-41b3-b665-b8ee923d88fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.273854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c4bf98965441678e2181db5293f64a', 'request_id': 'req-07163458-8161-41b3-b665-b8ee923d88fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.348100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c4bf98965441678e2181db5293f64a', 'request_id': 'req-07163458-8161-41b3-b665-b8ee923d88fe'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.359539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] The token cache is being invalidate because project 50c4bf98965441678e2181db5293f64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:17.359854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.360465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.362903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1099/2190] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:17 2022] DELETE /identity/v3/projects/50c4bf98965441678e2181db5293f64a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:17.366786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:17.368203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:17.382909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb007ea-1e90-4771-ac4f-c144e3a48e09 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:17.446763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:17.447665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:17.447948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:17.448399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] PATH_INFO: `/v3/users/28a8ae350f974f5a947913b8d2a8fb7d` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:17.449778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a8ae350f974f5a947913b8d2a8fb7d)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:17.451729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:17.801020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a8ae350f974f5a947913b8d2a8fb7d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.866875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a8ae350f974f5a947913b8d2a8fb7d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.886261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a8ae350f974f5a947913b8d2a8fb7d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.889255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a8ae350f974f5a947913b8d2a8fb7d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.889982 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2b3bb4c1-266f-4299-bd8c-bd369c5bd44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a8ae350f974f5a947913b8d2a8fb7d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:17.912808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1092/2191] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:17 2022] DELETE /identity/v3/users/28a8ae350f974f5a947913b8d2a8fb7d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:18.406853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:18.409356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:18.425283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07163458-8161-41b3-b665-b8ee923d88fe admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:18.497604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:18.499338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:18.499663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:18.499950 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] PATH_INFO: `/v3/projects/d97c0b7d01d540719b05c286dc8282b3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:18.503671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97c0b7d01d540719b05c286dc8282b3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:18.503923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:18.657047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97c0b7d01d540719b05c286dc8282b3', 'request_id': 'req-f7d0b920-c693-4574-9337-d9a591d19d3c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:18.663469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97c0b7d01d540719b05c286dc8282b3', 'request_id': 'req-f7d0b920-c693-4574-9337-d9a591d19d3c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:18.737636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97c0b7d01d540719b05c286dc8282b3', 'request_id': 'req-f7d0b920-c693-4574-9337-d9a591d19d3c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:18.754682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] The token cache is being invalidate because project d97c0b7d01d540719b05c286dc8282b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:18.754951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:18.755598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f7d0b920-c693-4574-9337-d9a591d19d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:18.759652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1100/2192] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:18 2022] DELETE /identity/v3/projects/d97c0b7d01d540719b05c286dc8282b3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:18.763669 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:18.764168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:18.764363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:18.801954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:18.804809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:18.882161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1093/2193] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:18.891259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:18.891675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:18.892056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:18.916627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:18.917927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:18.927982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1101/2194] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:51:18.930289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:18.941075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b94b01-dc61-4a8d-8ccd-377be86bddea None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:18.946472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:18.947263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:18.947546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:18.947848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:18.948698 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:51:18.949001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:18.950609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:18.963655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1094/2195] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:51:18.967751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:18.979334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44445c92-3b05-41da-9a9f-c17a6a9fdc54 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:18.984235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:18.989074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:18.989074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:18.989074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:18.989074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:18.989074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:19.100206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1102/2196] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:18 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:19.104393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:19.114748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cb228-fc26-4dde-b68c-095635d179d3 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:19.182558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:19.183249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:19.183536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:19.183898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:19.184615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:19.192793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:19.275120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1095/2197] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:19 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:19.279471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:19.291822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70cf3f-63cd-4c68-8e8b-cc8ccd5f2af4 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:19.296811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:19.297497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:19.297770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:19.298199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:19.299676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:19.301535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:19.313532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1103/2198] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:19.317949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:19.344826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3cbe1-2178-48b8-a08c-68e9c74e8273 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:19.353854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af636d8-1bad-4545-bec8-7ac46059e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:19.354873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af636d8-1bad-4545-bec8-7ac46059e92a admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:19.355175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af636d8-1bad-4545-bec8-7ac46059e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:19.355565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af636d8-1bad-4545-bec8-7ac46059e92a admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:19.356685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af636d8-1bad-4545-bec8-7ac46059e92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:19.358536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af636d8-1bad-4545-bec8-7ac46059e92a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:19.375827 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1096/2199] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:51:19.377310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:19.392199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4abfd3-09e4-4fe6-8051-257b46b1706c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:19.399353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:19.401001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:19.401654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:19.402994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] PATH_INFO: `/v3/projects/c11a284275a9453ebf3824d71e9a3564/users/5b477ee5db8f4fbf98585f60ac8852d8/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:19.426778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11a284275a9453ebf3824d71e9a3564, user_id=5b477ee5db8f4fbf98585f60ac8852d8, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:19.429477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:19.514948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1104/2200] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:19 2022] PUT /identity/v3/projects/c11a284275a9453ebf3824d71e9a3564/users/5b477ee5db8f4fbf98585f60ac8852d8/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:19.526587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb80c-461e-4c63-9062-74d26d5933a9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:19.526810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb80c-461e-4c63-9062-74d26d5933a9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:19.527084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09feb80c-461e-4c63-9062-74d26d5933a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:19.556922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-09feb80c-461e-4c63-9062-74d26d5933a9 None None] MFA Rules not processed for user `5b477ee5db8f4fbf98585f60ac8852d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:19.558161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-09feb80c-461e-4c63-9062-74d26d5933a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:19.624059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1097/2201] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:19.635897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:19.637855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:19.696129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d5845-ecd5-4ad1-8a9b-6b8872243605 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:19.699910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286046f-a7b6-4cc9-91ca-f96bbc23c376 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:19.700646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286046f-a7b6-4cc9-91ca-f96bbc23c376 service glance] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:19.701006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286046f-a7b6-4cc9-91ca-f96bbc23c376 service glance] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:19.701347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286046f-a7b6-4cc9-91ca-f96bbc23c376 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:19.710538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286046f-a7b6-4cc9-91ca-f96bbc23c376 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:19.712012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286046f-a7b6-4cc9-91ca-f96bbc23c376 service glance] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:19.720960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1105/2202] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:34.177332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554dc8-1bdc-4473-97c3-1e2c603fbd86 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:34.177823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554dc8-1bdc-4473-97c3-1e2c603fbd86 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:34.177937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7554dc8-1bdc-4473-97c3-1e2c603fbd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:34.195703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f7554dc8-1bdc-4473-97c3-1e2c603fbd86 None None] MFA Rules not processed for user `b578cbaa1cb247859e9eed23dc131734`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:34.196989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f7554dc8-1bdc-4473-97c3-1e2c603fbd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:34.263751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1098/2203] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:42.032410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:42.032410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:42.032410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:42.049927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] MFA Rules not processed for user `28b935fbbbb143cd94c9b54cec888607`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:42.051121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:42.105508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1106/2204] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:45.756574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:45.757064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:45.757522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:45.787493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:45.788601 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:45.877560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1099/2205] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:51:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:45.935222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:45.936831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:46.020363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9da77c-47e3-4a6e-b0c4-f17adf378759 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:46.027255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b82e3-eb0c-45d0-b902-56f01aba6c22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:46.027948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b82e3-eb0c-45d0-b902-56f01aba6c22 service swift] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:46.028237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b82e3-eb0c-45d0-b902-56f01aba6c22 service swift] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:46.028584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b82e3-eb0c-45d0-b902-56f01aba6c22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:46.040074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b82e3-eb0c-45d0-b902-56f01aba6c22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:46.042011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b82e3-eb0c-45d0-b902-56f01aba6c22 service swift] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:46.051240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1107/2206] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:51:50.539597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:50.622183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49c054-eb9c-4925-b7af-497557964c54 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:50.628164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:50.630491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:50.630491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:50.630491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] PATH_INFO: `/v3/users/5b477ee5db8f4fbf98585f60ac8852d8` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:50.631450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b477ee5db8f4fbf98585f60ac8852d8)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:50.633439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:50.890627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b477ee5db8f4fbf98585f60ac8852d8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:50.993769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b477ee5db8f4fbf98585f60ac8852d8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:51.003689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b477ee5db8f4fbf98585f60ac8852d8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:51.005120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b477ee5db8f4fbf98585f60ac8852d8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:51.005740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b477ee5db8f4fbf98585f60ac8852d8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:51.043228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1100/2207] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:50 2022] DELETE /identity/v3/users/5b477ee5db8f4fbf98585f60ac8852d8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:51.047664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:51.048550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:51.048836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:51.070685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:51.072434 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:51.149904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1108/2208] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:51.165472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:51.167029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:51.238948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ed30a-222f-41a7-85fc-08cf96e35191 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:51.243530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffed7d4-46a5-4e89-aefc-1e5fef1bdeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:51.244706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed7d4-46a5-4e89-aefc-1e5fef1bdeeb service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:51.245068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed7d4-46a5-4e89-aefc-1e5fef1bdeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:51.245415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffed7d4-46a5-4e89-aefc-1e5fef1bdeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:51.260776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed7d4-46a5-4e89-aefc-1e5fef1bdeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:51.260776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffed7d4-46a5-4e89-aefc-1e5fef1bdeeb service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:51.270948 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1101/2209] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:51.884039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:51.885775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:51.900905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730c6ab-0eea-4b53-a62e-614315b946e5 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:51.911389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:51.912490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:51.913575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:51.913575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] PATH_INFO: `/v3/projects/c11a284275a9453ebf3824d71e9a3564` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:51.914634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11a284275a9453ebf3824d71e9a3564)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:51.916741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:52.060829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11a284275a9453ebf3824d71e9a3564', 'request_id': 'req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:52.067140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11a284275a9453ebf3824d71e9a3564', 'request_id': 'req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:52.147484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11a284275a9453ebf3824d71e9a3564', 'request_id': 'req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:52.159851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] The token cache is being invalidate because project c11a284275a9453ebf3824d71e9a3564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:52.161027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:52.162083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8e69ddc7-fffa-4b5e-b464-9e59474d6e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:52.169650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1109/2210] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:51 2022] DELETE /identity/v3/projects/c11a284275a9453ebf3824d71e9a3564 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:52.170349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.170796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.170906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.189770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:52.190985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:52.257919 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1102/2211] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:52.265873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.266160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.266440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.315095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:52.316363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:52.356982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1110/2212] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:52.361278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:52.374891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3586bcd-1826-4fd4-8db4-fffa26a80350 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:52.383367 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:52.385270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.385734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.386170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.387833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:51:52.388801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:52.391256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:52.423248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1103/2213] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:51:52.427593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:52.438940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb1fb1-96ee-4e25-86f3-acf501d0c780 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:52.462781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:52.463849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.464190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.464601 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.465439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:52.467492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:52.601345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1111/2214] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:52 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:52.602423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:52.621000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b0a041-1cc5-449c-9ec1-57d09123ca44 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:52.761282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:52.762575 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.762873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.763148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.763896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:52.765847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:52.892792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:52.893213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1104/2215] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:52 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:51:52.904980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ada2-a337-48b7-aaa0-bf5296b0d829 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:52.921980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:52.922656 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.922933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.923234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.923963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:52.925580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:52.952771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1112/2216] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:52.960413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:52.979379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02d616-87ac-4838-be44-2e43fa526359 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:52.990965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc465667-c402-4d85-9efb-b8fa694bc298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:52.991940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc465667-c402-4d85-9efb-b8fa694bc298 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:52.992465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc465667-c402-4d85-9efb-b8fa694bc298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:52.992838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc465667-c402-4d85-9efb-b8fa694bc298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:52.993671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc465667-c402-4d85-9efb-b8fa694bc298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:52.995346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc465667-c402-4d85-9efb-b8fa694bc298 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:53.017034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1105/2217] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:51:53.021457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:53.032935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea7701-48e2-4320-9774-89e8f93b92aa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:53.048995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:53.050596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:53.051665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:53.052172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] PATH_INFO: `/v3/projects/425919888203465eafef43f103a7fe28/users/3ba70a01fcd249d3bc82b2e971d4be52/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:53.079451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] RBAC: Authorizing `identity:create_grant(project_id=425919888203465eafef43f103a7fe28, user_id=3ba70a01fcd249d3bc82b2e971d4be52, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:53.088293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:53.221117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1113/2218] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:53 2022] PUT /identity/v3/projects/425919888203465eafef43f103a7fe28/users/3ba70a01fcd249d3bc82b2e971d4be52/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:53.233595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:53.234583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:53.235045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:53.265494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] MFA Rules not processed for user `3ba70a01fcd249d3bc82b2e971d4be52`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:53.266730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:53.402664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1106/2219] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:53.415468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:53.423849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:53.505611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b140c67-5bda-40b5-a7cf-1adbfb60439e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:53.509561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843ec11-ec19-4038-a723-64eb10c39ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:53.510205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ec11-ec19-4038-a723-64eb10c39ceb service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:53.510492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ec11-ec19-4038-a723-64eb10c39ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:53.510772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843ec11-ec19-4038-a723-64eb10c39ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:53.520952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ec11-ec19-4038-a723-64eb10c39ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:53.522470 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843ec11-ec19-4038-a723-64eb10c39ceb service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:53.532564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1114/2220] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:53.559679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:53.654820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291e17-eda4-45cc-a3c0-c96995b2b0c3 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:53.654820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:53.654820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:53.654820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:53.655152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] PATH_INFO: `/v3/users/3ba70a01fcd249d3bc82b2e971d4be52` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:53.655152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba70a01fcd249d3bc82b2e971d4be52)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:53.655152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:54.172241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba70a01fcd249d3bc82b2e971d4be52'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:54.257256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba70a01fcd249d3bc82b2e971d4be52'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:54.267375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba70a01fcd249d3bc82b2e971d4be52'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:54.268281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba70a01fcd249d3bc82b2e971d4be52'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:54.269181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba70a01fcd249d3bc82b2e971d4be52'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:54.294878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1107/2221] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:51:53 2022] DELETE /identity/v3/users/3ba70a01fcd249d3bc82b2e971d4be52 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:54.298641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:54.299183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:54.299284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:54.328165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:54.329399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:54.473506 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1115/2222] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:54.480536 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:54.482345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:54.556633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb5a99-2df3-4838-8273-f3da252d9a66 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:54.561002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae6c9-24cd-45f3-b3f3-f241202968a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:54.561806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae6c9-24cd-45f3-b3f3-f241202968a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:54.562086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae6c9-24cd-45f3-b3f3-f241202968a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:54.562468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae6c9-24cd-45f3-b3f3-f241202968a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:54.575243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae6c9-24cd-45f3-b3f3-f241202968a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:54.576740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae6c9-24cd-45f3-b3f3-f241202968a2 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:54.588833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1108/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:51:55.203386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:55.204574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:55.235196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64b0aa-b2fd-4abf-96d8-875a0b60396d None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:55.265108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:55.266667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:55.266959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:55.267241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] PATH_INFO: `/v3/projects/425919888203465eafef43f103a7fe28` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:55.268714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425919888203465eafef43f103a7fe28)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:55.271452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:55.417588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425919888203465eafef43f103a7fe28', 'request_id': 'req-90837c49-0320-4521-93d5-1721a0549d95'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:55.428226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425919888203465eafef43f103a7fe28', 'request_id': 'req-90837c49-0320-4521-93d5-1721a0549d95'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:55.531107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425919888203465eafef43f103a7fe28', 'request_id': 'req-90837c49-0320-4521-93d5-1721a0549d95'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:55.546189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] The token cache is being invalidate because project 425919888203465eafef43f103a7fe28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:51:55.546814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:55.547952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-90837c49-0320-4521-93d5-1721a0549d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:51:55.554613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1116/2224] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:51:55 2022] DELETE /identity/v3/projects/425919888203465eafef43f103a7fe28 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:55.555479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:55.555975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:55.556081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:55.575968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:55.578250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:55.688921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1109/2225] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:55.692322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:55.692854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:55.693343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:55.720879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:55.723331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:55.742625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1117/2226] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:55.743571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:55.759038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c80d9-b6ad-41f0-9bd6-eb2bbfd8334b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:55.763930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:55.764705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:55.764995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:55.765283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:55.766643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:51:55.766955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:55.768595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:55.786618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1110/2227] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:51:55.791026 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:55.801335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442a47a-3de4-41dd-abd2-a05c5431ef1c None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:55.807143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:55.807874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:55.808160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:55.808430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:55.809298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:55.811216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:55.901284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1118/2228] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:51:55 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:55.905609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:55.917371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ab3d-c76e-485f-bc1b-03fceb126425 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:55.991316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:55.992042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:55.992320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:55.992597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:55.993357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:55.995245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:56.091639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1111/2229] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:51:55 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:51:56.095889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:56.107744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61070b9d-0a03-4260-8132-88b77c01bb32 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:56.112676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:56.113373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:56.113653 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:56.113931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:56.114657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:56.116596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:56.128590 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1119/2230] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:56.132323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:56.147828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a9fe-bcc2-4e7a-8082-b76b1bf89dd7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:56.153141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e2ee-e493-4833-b75c-868409a290e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:56.153817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e2ee-e493-4833-b75c-868409a290e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:56.154089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e2ee-e493-4833-b75c-868409a290e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:56.154363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e2ee-e493-4833-b75c-868409a290e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:56.155142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e2ee-e493-4833-b75c-868409a290e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:56.156951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e2ee-e493-4833-b75c-868409a290e6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:56.173003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1112/2231] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:51:56.177367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:56.191645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf489-026e-4c22-9ac3-f8e4307152f2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:56.198397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:56.201910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:56.201910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:56.201910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] PATH_INFO: `/v3/projects/21eb12adce404f178fab98c30fd5aa77/users/c3a3559d3f58433ba7da9869ebd18aea/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:56.222106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] RBAC: Authorizing `identity:create_grant(project_id=21eb12adce404f178fab98c30fd5aa77, user_id=c3a3559d3f58433ba7da9869ebd18aea, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:56.227387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:56.322720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1120/2232] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:51:56 2022] PUT /identity/v3/projects/21eb12adce404f178fab98c30fd5aa77/users/c3a3559d3f58433ba7da9869ebd18aea/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:51:56.330525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78e7a2-3a57-4b64-abb1-2a9da82cd953 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:56.331203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78e7a2-3a57-4b64-abb1-2a9da82cd953 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:56.331693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78e7a2-3a57-4b64-abb1-2a9da82cd953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:56.355240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4e78e7a2-3a57-4b64-abb1-2a9da82cd953 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:51:56.356833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4e78e7a2-3a57-4b64-abb1-2a9da82cd953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:56.437646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1113/2233] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:51:56.449162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:51:56.450993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:51:56.551722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309d91c-6165-4233-a072-c315b33000da admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:51:56.556388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:51:56.557110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:51:56.557393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:51:56.557740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:51:56.568393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:51:56.571021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:51:56.589015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1121/2234] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:52:04.278619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.279106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.279197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.306334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] MFA Rules not processed for user `c3a3559d3f58433ba7da9869ebd18aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:04.307519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:04.372916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1114/2235] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:52:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:04.377376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:04.387132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d2561-d6a8-405d-8406-0a2b462dd28e service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:04.391743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:04.396532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.396532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.396532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.396532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:04.396532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:04.486170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1122/2236] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:52:04.490864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:04.501490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87265ed-18e1-44b5-8c0f-563aad883280 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:04.558329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:04.559009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.559290 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.559567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.560358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:04.562321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:04.637076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1115/2237] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:52:04 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:52:04.641086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:04.652575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915083e-86f5-4780-b1fa-0f0de332fe35 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:04.657557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:04.658218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.658495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.658767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.659516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:04.661813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:04.678132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1123/2238] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:52:04.682425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:04.697188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c954eb-24d0-4d44-a229-1792b151a65c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:04.702350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:04.703468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.703842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.704116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] PATH_INFO: `/v3/projects/ef43bec696814a45965f30ef4b98bfd8/users/25b259309ad9453485b420864bb8dc87/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.724573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef43bec696814a45965f30ef4b98bfd8, user_id=25b259309ad9453485b420864bb8dc87, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:04.727525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:04.796384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1116/2239] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:52:04 2022] PUT /identity/v3/projects/ef43bec696814a45965f30ef4b98bfd8/users/25b259309ad9453485b420864bb8dc87/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:52:04.800469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:04.810586 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437cceb-1219-4394-b2cb-4faadfee48f0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:04.873504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23517fb-ca7a-47cb-b955-20e0d804f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:04.874185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23517fb-ca7a-47cb-b955-20e0d804f65f admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.874492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23517fb-ca7a-47cb-b955-20e0d804f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.874760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23517fb-ca7a-47cb-b955-20e0d804f65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.875491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23517fb-ca7a-47cb-b955-20e0d804f65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:04.877229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23517fb-ca7a-47cb-b955-20e0d804f65f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:04.887813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1124/2240] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:52:04.892368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:04.902910 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d32ed0-a6e6-434d-bf35-e0d25a6afbca admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:04.907517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:04.908411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:04.908759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:04.908969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] PATH_INFO: `/v3/projects/ef43bec696814a45965f30ef4b98bfd8/users/25b259309ad9453485b420864bb8dc87/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:04.910976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef43bec696814a45965f30ef4b98bfd8, user_id=25b259309ad9453485b420864bb8dc87, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:04.913881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:04.924522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1117/2241] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:52:04 2022] PUT /identity/v3/projects/ef43bec696814a45965f30ef4b98bfd8/users/25b259309ad9453485b420864bb8dc87/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:52:06.341776 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153533b5-4323-4f11-9b97-be146423a20f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:06.342271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153533b5-4323-4f11-9b97-be146423a20f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:06.342363 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153533b5-4323-4f11-9b97-be146423a20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:06.400487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-153533b5-4323-4f11-9b97-be146423a20f None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:06.402323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-153533b5-4323-4f11-9b97-be146423a20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:06.542360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1125/2242] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:52:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:06.543023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:06.544955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:06.721245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800167-b4ac-49c9-ba32-684826c1e80c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:06.725011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654625b9-2113-4471-b23a-683e1ce9c232 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:06.726422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654625b9-2113-4471-b23a-683e1ce9c232 service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:06.726878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654625b9-2113-4471-b23a-683e1ce9c232 service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:06.727459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654625b9-2113-4471-b23a-683e1ce9c232 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:06.739323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654625b9-2113-4471-b23a-683e1ce9c232 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:06.741480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654625b9-2113-4471-b23a-683e1ce9c232 service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:06.755150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1118/2243] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:52:08.837627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1cb6-1330-4623-afd4-cf463bfaae29 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:08.838198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1cb6-1330-4623-afd4-cf463bfaae29 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:08.838422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1cb6-1330-4623-afd4-cf463bfaae29 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:08.840292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1126/2244] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:52:08.850738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff7b9-b416-4e81-acfa-fd2eab88adf8 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:08.851287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff7b9-b416-4e81-acfa-fd2eab88adf8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:08.851287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff7b9-b416-4e81-acfa-fd2eab88adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:09.049660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-32fff7b9-b416-4e81-acfa-fd2eab88adf8 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:09.050941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-32fff7b9-b416-4e81-acfa-fd2eab88adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:09.245088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1119/2245] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:52:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:52:09.257666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1cb6-1330-4623-afd4-cf463bfaae29 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:09.262039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-533c1cb6-1330-4623-afd4-cf463bfaae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:09.484904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1cb6-1330-4623-afd4-cf463bfaae29 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:09.495817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd58ec1-daa9-4cff-9630-41927902ccb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:09.495817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58ec1-daa9-4cff-9630-41927902ccb3 service glance] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:09.497173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58ec1-daa9-4cff-9630-41927902ccb3 service glance] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:09.497809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd58ec1-daa9-4cff-9630-41927902ccb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:09.518435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58ec1-daa9-4cff-9630-41927902ccb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:09.521516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd58ec1-daa9-4cff-9630-41927902ccb3 service glance] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:09.539391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1127/2246] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:52:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:52:09.834443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9b66b-f67f-4bf0-9da5-5123afd6f540 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:09.834905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9b66b-f67f-4bf0-9da5-5123afd6f540 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:09.835430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9b66b-f67f-4bf0-9da5-5123afd6f540 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:09.837025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1120/2247] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:52:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 03 22:52:09.842986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e3d8e-b25c-4734-b940-93bd66cd493f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:09.843939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e3d8e-b25c-4734-b940-93bd66cd493f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:09.845923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e3d8e-b25c-4734-b940-93bd66cd493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:09.872836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-248e3d8e-b25c-4734-b940-93bd66cd493f None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:09.874255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-248e3d8e-b25c-4734-b940-93bd66cd493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:09.955708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1128/2248] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:52:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:52:09.968710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9b66b-f67f-4bf0-9da5-5123afd6f540 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:09.982617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9b66b-f67f-4bf0-9da5-5123afd6f540 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:09.997878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523256eb-aa79-476d-b191-2022066791a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:09.998549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523256eb-aa79-476d-b191-2022066791a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:09.998834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523256eb-aa79-476d-b191-2022066791a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:09.999108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523256eb-aa79-476d-b191-2022066791a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:10.016866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523256eb-aa79-476d-b191-2022066791a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:10.018671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523256eb-aa79-476d-b191-2022066791a3 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:10.029988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1121/2249] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:52:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:52:10.201380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2ec72-f9d8-409f-b774-f3c70276ffcb None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:10.201665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2ec72-f9d8-409f-b774-f3c70276ffcb None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:10.201947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2ec72-f9d8-409f-b774-f3c70276ffcb None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:10.203492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1129/2250] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:52:10.210638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9284-835f-41c3-8873-0e39888e4b67 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:10.211454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9284-835f-41c3-8873-0e39888e4b67 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:10.212058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9284-835f-41c3-8873-0e39888e4b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:10.258023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-310e9284-835f-41c3-8873-0e39888e4b67 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:10.259740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-310e9284-835f-41c3-8873-0e39888e4b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:10.287590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1122/2251] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:52:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:10.310931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2ec72-f9d8-409f-b774-f3c70276ffcb None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:10.326269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2ec72-f9d8-409f-b774-f3c70276ffcb None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:10.333687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:10.334354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:10.335209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:10.335496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:10.355413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:10.358981 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:10.407966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1130/2252] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:52:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:52:13.408932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a019-1a57-408a-8dd3-a80a6dc90867 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:13.410262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a019-1a57-408a-8dd3-a80a6dc90867 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:13.410724 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3a019-1a57-408a-8dd3-a80a6dc90867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:13.475652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-44a3a019-1a57-408a-8dd3-a80a6dc90867 None None] MFA Rules not processed for user `25b259309ad9453485b420864bb8dc87`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:13.478923 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-44a3a019-1a57-408a-8dd3-a80a6dc90867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:13.614758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1123/2253] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:52:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:13.631744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:13.642523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a9f35-c168-40a6-9564-fe7a3b113e7e service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:13.655142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:13.655957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:13.656339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:13.656619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:13.743749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:13.745455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:13.756635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1131/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:52:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:52:14.126987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157149-e9d2-402f-acdf-d50fbcc42275 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:14.127284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157149-e9d2-402f-acdf-d50fbcc42275 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:14.127564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56157149-e9d2-402f-acdf-d50fbcc42275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:14.157031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-56157149-e9d2-402f-acdf-d50fbcc42275 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:14.158376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-56157149-e9d2-402f-acdf-d50fbcc42275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:14.170295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1124/2255] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:52:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:14.183459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:14.199879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09576d4-ce67-4898-adca-603f8cacc47c service glance] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:14.207457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902bfb7-c732-41bc-b3a7-355c04a5925b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:14.208298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902bfb7-c732-41bc-b3a7-355c04a5925b service swift] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:14.208458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902bfb7-c732-41bc-b3a7-355c04a5925b service swift] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:14.208732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902bfb7-c732-41bc-b3a7-355c04a5925b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:14.219635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902bfb7-c732-41bc-b3a7-355c04a5925b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:14.221249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902bfb7-c732-41bc-b3a7-355c04a5925b service swift] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:14.232379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1132/2256] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:52:24.305294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:24.305902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:24.305902 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:24.328267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] MFA Rules not processed for user `b9282b0e5cbb458bb31d462a76832aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:24.330128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:24.429550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1125/2257] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:28.509990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aab968-260b-40a0-a531-8e209ddf0a2c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:28.510548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aab968-260b-40a0-a531-8e209ddf0a2c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:28.510548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aab968-260b-40a0-a531-8e209ddf0a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:28.528754 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-98aab968-260b-40a0-a531-8e209ddf0a2c None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:28.530030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-98aab968-260b-40a0-a531-8e209ddf0a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:28.538332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1133/2258] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:52:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:28.557219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:28.562483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd8d45-e39e-4f0d-baa0-c5018a3b4c3b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:28.568044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9a670-92e4-4d6f-8d15-0bcb89063e1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:28.568703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a670-92e4-4d6f-8d15-0bcb89063e1d service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:28.568985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a670-92e4-4d6f-8d15-0bcb89063e1d service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:28.569261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9a670-92e4-4d6f-8d15-0bcb89063e1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:28.577426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9a670-92e4-4d6f-8d15-0bcb89063e1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:28.579017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9a670-92e4-4d6f-8d15-0bcb89063e1d service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:28.587110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1126/2259] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:52:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:52:28.650667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:28.650960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:28.651239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:28.669747 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] MFA Rules not processed for user `c3a3559d3f58433ba7da9869ebd18aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:28.670944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:28.679084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1134/2260] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:52:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:29.565411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:29.566392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:29.566846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:29.600898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:29.602466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:29.614196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1127/2261] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 22:52:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:29.642304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:29.668139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8821dc-4b89-4ef7-8cd1-5b46b93e5169 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:29.695825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:29.697292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:29.698153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:29.698851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:29.715990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:29.718642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:29.728342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1135/2262] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 22:52:34.676732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:34.678173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:34.748416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fdf26-531f-4d09-b47c-3f2f114f1e3a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:34.758194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:34.758493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:34.758778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:34.759056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] PATH_INFO: `/v3/users/b578cbaa1cb247859e9eed23dc131734` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:34.766039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b578cbaa1cb247859e9eed23dc131734)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:34.766039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:34.977254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b578cbaa1cb247859e9eed23dc131734'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.071618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b578cbaa1cb247859e9eed23dc131734'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.077300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b578cbaa1cb247859e9eed23dc131734'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.078138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b578cbaa1cb247859e9eed23dc131734'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.078984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b578cbaa1cb247859e9eed23dc131734'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.098806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1128/2263] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:52:34 2022] DELETE /identity/v3/users/b578cbaa1cb247859e9eed23dc131734 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:52:35.414405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:35.436293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd862fb4-b0f7-45ec-9422-6ad90de325c9 service swift] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:35.521793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:35.522907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:35.523177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:35.523456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] PATH_INFO: `/v3/projects/dab3317553d1476a8a034b78dc5572b2` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:35.524744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab3317553d1476a8a034b78dc5572b2)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:35.526716 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:35.663790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab3317553d1476a8a034b78dc5572b2', 'request_id': 'req-4cc4347e-68b1-43e7-9543-34da99e75554'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.668963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab3317553d1476a8a034b78dc5572b2', 'request_id': 'req-4cc4347e-68b1-43e7-9543-34da99e75554'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.736276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab3317553d1476a8a034b78dc5572b2', 'request_id': 'req-4cc4347e-68b1-43e7-9543-34da99e75554'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.750173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] The token cache is being invalidate because project dab3317553d1476a8a034b78dc5572b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:52:35.750552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.751271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:52:35.755189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1136/2264] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:52:35 2022] DELETE /identity/v3/projects/dab3317553d1476a8a034b78dc5572b2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:52:39.625105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:39.625671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:39.627469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:39.628075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:39.728186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995b8f8-d702-4dda-a636-98fd8017b830 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:39.776463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4347e-68b1-43e7-9543-34da99e75554 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:39.781431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:39.782073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:39.782379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:39.782658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:39.784443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:39.795688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:39.795855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:39.796357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:39.796636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:39.796952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:39.797417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20262bf0-4bde-4061-a96d-e0bedf76bc25 service placement] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:39.806225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:39.807402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1137/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:52:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:52:39.807891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:39.818632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1129/2266] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:52:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:52:41.909286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676b9d-e24a-42bf-a432-75b32b46942f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:41.909286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676b9d-e24a-42bf-a432-75b32b46942f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:41.909875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5676b9d-e24a-42bf-a432-75b32b46942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:41.928012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f5676b9d-e24a-42bf-a432-75b32b46942f None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:41.929219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f5676b9d-e24a-42bf-a432-75b32b46942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:41.993228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1138/2267] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:52:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:42.006490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:42.008062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:42.103720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5d13-6cc8-4bc6-9b6d-9834ffdbfc83 service placement] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:42.109632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:42.110141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:42.110426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:42.110709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:42.120043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:42.121648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:42.130874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1130/2268] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:52:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:52:58.935098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:58.935671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:58.935671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:58.955011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:52:58.956305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:52:58.964074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1139/2269] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 22:52:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:52:58.987130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:52:58.997924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66d54-33f8-4fe9-97bd-b8783c20813a service swift] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:52:59.002916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b50197-869a-404e-8dc7-0119bef87d10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:52:59.003574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50197-869a-404e-8dc7-0119bef87d10 service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:52:59.004515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50197-869a-404e-8dc7-0119bef87d10 service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:52:59.004775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b50197-869a-404e-8dc7-0119bef87d10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:52:59.012701 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b50197-869a-404e-8dc7-0119bef87d10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:52:59.014266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b50197-869a-404e-8dc7-0119bef87d10 service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:52:59.022356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1131/2270] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:52:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:53:17.048830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:53:17.050259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:53:17.103413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455f73-662d-48c5-b781-41bf0eabf844 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:53:17.116468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:53:17.117137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:53:17.117423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:53:17.117796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:53:17.119689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:53:17.198290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:53:17.199706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d1c3-f0b2-4dd7-a77d-7a34492b34f1 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:53:17.211778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1140/2271] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:53:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:53:23.242800 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a90bc-a114-4eb7-83dd-fc9714dba709 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:53:23.243340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a90bc-a114-4eb7-83dd-fc9714dba709 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:53:23.243340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a90bc-a114-4eb7-83dd-fc9714dba709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:53:23.261770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9e2a90bc-a114-4eb7-83dd-fc9714dba709 None None] MFA Rules not processed for user `28b935fbbbb143cd94c9b54cec888607`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:53:23.263248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9e2a90bc-a114-4eb7-83dd-fc9714dba709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:53:23.317409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1132/2272] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:53:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:53:57.145524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd93eab-6787-4ce3-abe8-6eff23c72d1a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:53:57.146036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd93eab-6787-4ce3-abe8-6eff23c72d1a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:53:57.146133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd93eab-6787-4ce3-abe8-6eff23c72d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:53:57.163159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0cd93eab-6787-4ce3-abe8-6eff23c72d1a None None] MFA Rules not processed for user `d7353d5eef814367844ffbb574c6a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:53:57.164648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0cd93eab-6787-4ce3-abe8-6eff23c72d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:53:57.219847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1141/2273] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:07.320552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:07.321070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:07.321319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:07.339484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] MFA Rules not processed for user `b9282b0e5cbb458bb31d462a76832aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:07.340747 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:07.394284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1133/2274] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:22.664327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:22.664848 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:22.664952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:22.686495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] MFA Rules not processed for user `dd0ac9313e0149bbaabbcbeaa35b1d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:22.687803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:22.744954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1142/2275] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:35.307708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:35.317222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549afa-6343-4794-a4b9-d17127e249bb None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:35.320779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:35.321415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:35.321689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:35.321966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:35.323769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:35.399180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:35.400567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:35.412191 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1134/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:54:35.949615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:35.958821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46a22b-9b9a-459c-b3f0-c2c50aafa2b8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:35.963039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:35.963693 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:35.963973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:35.964243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:35.965959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:35.979092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:35.980594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:35.991588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1143/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:54:39.943454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:39.951680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde00b6-cdf4-4cbf-b30e-130d54a7727a service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:39.955245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:39.955932 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:39.956230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:39.956505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:39.958223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:40.020711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:40.022146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:40.031720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1135/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:54:44.038325 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:44.040053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:44.053179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08649e13-0540-49cc-9dba-e82f45b76ac1 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:44.058154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:44.059052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:44.059340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:44.059634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] PATH_INFO: `/v3/users/28b935fbbbb143cd94c9b54cec888607` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:44.060813 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b935fbbbb143cd94c9b54cec888607)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:44.062720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:44.285527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b935fbbbb143cd94c9b54cec888607'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.364510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b935fbbbb143cd94c9b54cec888607'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.372343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b935fbbbb143cd94c9b54cec888607'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.372967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b935fbbbb143cd94c9b54cec888607'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.384060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-278e56fc-731b-45c3-831a-4b7e7c439ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b935fbbbb143cd94c9b54cec888607'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.389903 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1144/2279] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:54:44 2022] DELETE /identity/v3/users/28b935fbbbb143cd94c9b54cec888607 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:44.628473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:44.638425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421ce4f-d45b-4bbc-be26-2d257b1f21b3 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:44.695912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:44.696763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:44.697061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:44.697315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] PATH_INFO: `/v3/projects/6a1de14c94b24239a57669664273a33e` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:44.698768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1de14c94b24239a57669664273a33e)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:44.700739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:44.797967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1de14c94b24239a57669664273a33e', 'request_id': 'req-cb1f535c-7606-4e34-bf61-b9da13f0403a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.803519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1de14c94b24239a57669664273a33e', 'request_id': 'req-cb1f535c-7606-4e34-bf61-b9da13f0403a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.855381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1de14c94b24239a57669664273a33e', 'request_id': 'req-cb1f535c-7606-4e34-bf61-b9da13f0403a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.866304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] The token cache is being invalidate because project 6a1de14c94b24239a57669664273a33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:54:44.866586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.867325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cb1f535c-7606-4e34-bf61-b9da13f0403a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:44.868868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1136/2280] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:54:44 2022] DELETE /identity/v3/projects/6a1de14c94b24239a57669664273a33e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:44.873745 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:44.873980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:44.874258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:44.891269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:44.895897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:44.951462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1145/2281] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:44.965695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:44.966013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:44.966287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:44.984097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:44.985314 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:44.993056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1137/2282] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:44.997335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.006708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42701107-9c63-40e8-b5c9-efb335ef956b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.013526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.017173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.017173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.017173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.017173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:54:45.017173 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.018933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.031196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1146/2283] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:54:45.035366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.044714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f12cd-a5a6-4859-ba24-3f0f9a880713 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.049360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.049990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.050264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.050532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.051218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.053157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.142862 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1138/2284] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:54:45 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:45.146220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.156945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ff703-1737-41eb-9864-be90bac7efba admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.210122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.210782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.211739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.212021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.212719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.214634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.278879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1147/2285] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:54:45 2022] POST /identity/v3/users => generated 303 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:54:45.283030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.293434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52892531-b597-48ef-a07a-667227e28e83 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.298065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.298927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.299205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.299476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.300237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.301899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.313054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1139/2286] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:45.317080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.327968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa0d31-4e89-4ece-8606-320d600784ec admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.332597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81437b0d-41c5-45d6-ac14-272fb14d8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.333459 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437b0d-41c5-45d6-ac14-272fb14d8fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.333900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437b0d-41c5-45d6-ac14-272fb14d8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.334189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81437b0d-41c5-45d6-ac14-272fb14d8fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.334918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81437b0d-41c5-45d6-ac14-272fb14d8fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.336563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81437b0d-41c5-45d6-ac14-272fb14d8fcb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.346680 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1148/2287] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:54:45.350858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.361212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f400927-808a-4fd2-b3c7-56096a881025 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.366583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.368077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.368352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.368619 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] PATH_INFO: `/v3/projects/6e6d04190f8249b39c95f4b08385a1c7/users/b27d785b2c4541019494dbc3f9081f67/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.383390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6d04190f8249b39c95f4b08385a1c7, user_id=b27d785b2c4541019494dbc3f9081f67, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.386238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.472909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1140/2288] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:54:45 2022] PUT /identity/v3/projects/6e6d04190f8249b39c95f4b08385a1c7/users/b27d785b2c4541019494dbc3f9081f67/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:45.477804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceae2a-ac2f-4b8f-888f-55ba9589ac4b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.478088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceae2a-ac2f-4b8f-888f-55ba9589ac4b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.478365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceae2a-ac2f-4b8f-888f-55ba9589ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.495990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d4ceae2a-ac2f-4b8f-888f-55ba9589ac4b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:45.497157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d4ceae2a-ac2f-4b8f-888f-55ba9589ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:45.553495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1149/2289] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:45.563454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:45.565130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:45.619728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedda20a-7f48-4112-80c8-c7fb47570d30 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:45.623272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:45.623934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:45.624211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:45.624488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:45.633729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:45.635165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:45.644275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1141/2290] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:54:46.850295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:46.850809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:46.850906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:46.877374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] MFA Rules not processed for user `b27d785b2c4541019494dbc3f9081f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:46.878681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:46.942118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1150/2291] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:46.947116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:46.956730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd7dc1-29cf-4be8-a0d0-09991fc2e38d service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:46.961294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:46.961933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:46.962218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:46.962496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:46.963193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:46.965133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:47.057435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1142/2292] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:54:46 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:47.061396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:47.072626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c8b24-8784-4f0b-ba35-fc5db0c23a5e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:47.126706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:47.127362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:47.127669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:47.127947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:47.128626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:47.130541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:47.221170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1151/2293] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:54:47 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:47.225089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:47.235840 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b795fb6-b4b8-471e-a895-ed4aeb7b5fb9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:47.241686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:47.243015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:47.243301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:47.243580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:47.244338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:47.245947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:47.256399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1143/2294] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:47.260430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:47.270089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dd1f-0cd2-412b-a54f-17674d578cca admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:47.274525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:47.275382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:47.275692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:47.275964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] PATH_INFO: `/v3/projects/f0a6f9fb457143c08c173fa8f82514bf/users/3b079d7b2b9044698aa57234f838f416/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:47.291009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a6f9fb457143c08c173fa8f82514bf, user_id=3b079d7b2b9044698aa57234f838f416, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:47.293796 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:47.364124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1152/2295] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:54:47 2022] PUT /identity/v3/projects/f0a6f9fb457143c08c173fa8f82514bf/users/3b079d7b2b9044698aa57234f838f416/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:47.368671 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:47.378467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f04ce-b697-4241-8133-555afaeb13ad admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:47.434295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2868c28-884e-4401-9a43-c6764c0d3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:47.434973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868c28-884e-4401-9a43-c6764c0d3718 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:47.435243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868c28-884e-4401-9a43-c6764c0d3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:47.435518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2868c28-884e-4401-9a43-c6764c0d3718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:47.436275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868c28-884e-4401-9a43-c6764c0d3718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:47.437870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2868c28-884e-4401-9a43-c6764c0d3718 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:47.447448 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1144/2296] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:47.451542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:47.461480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58625794-208f-4992-a9ea-520d71021977 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:47.465940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:47.466800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:47.467076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:47.467346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] PATH_INFO: `/v3/projects/f0a6f9fb457143c08c173fa8f82514bf/users/3b079d7b2b9044698aa57234f838f416/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:47.469305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a6f9fb457143c08c173fa8f82514bf, user_id=3b079d7b2b9044698aa57234f838f416, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:47.471962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:47.482606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1153/2297] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:54:47 2022] PUT /identity/v3/projects/f0a6f9fb457143c08c173fa8f82514bf/users/3b079d7b2b9044698aa57234f838f416/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:54:48.641563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:48.642045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:48.642138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:48.668123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] MFA Rules not processed for user `3b079d7b2b9044698aa57234f838f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:48.669334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:48.737673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1145/2298] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:49.998874 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:50.059373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b378f-7c4d-4714-a0bf-61095b90de20 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:50.064050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:50.064916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:50.065203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:50.065485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] PATH_INFO: `/v3/users/b27d785b2c4541019494dbc3f9081f67` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:50.066672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27d785b2c4541019494dbc3f9081f67)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:50.068702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:50.239832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27d785b2c4541019494dbc3f9081f67'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.301213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27d785b2c4541019494dbc3f9081f67'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.308346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27d785b2c4541019494dbc3f9081f67'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.308987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27d785b2c4541019494dbc3f9081f67'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.322041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27d785b2c4541019494dbc3f9081f67'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.331572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1154/2299] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:54:49 2022] DELETE /identity/v3/users/b27d785b2c4541019494dbc3f9081f67 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:50.572343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:50.584626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ac9cd-be0f-4404-9219-ef31be289e8c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:50.639914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:50.640797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:50.641079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:50.641352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] PATH_INFO: `/v3/projects/6e6d04190f8249b39c95f4b08385a1c7` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:50.642529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6d04190f8249b39c95f4b08385a1c7)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:50.644477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:50.775745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6d04190f8249b39c95f4b08385a1c7', 'request_id': 'req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.781244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6d04190f8249b39c95f4b08385a1c7', 'request_id': 'req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.855355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6d04190f8249b39c95f4b08385a1c7', 'request_id': 'req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.866700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] The token cache is being invalidate because project 6e6d04190f8249b39c95f4b08385a1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:54:50.867474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.868183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:50.871960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1146/2300] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:54:50 2022] DELETE /identity/v3/projects/6e6d04190f8249b39c95f4b08385a1c7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:50.873646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:50.875027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:50.888391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be80321-fbdc-4568-b544-68e564f16bfb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:50.943460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:50.944338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:50.944618 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:50.944892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] PATH_INFO: `/v3/users/3b079d7b2b9044698aa57234f838f416` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:50.946091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b079d7b2b9044698aa57234f838f416)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:50.948021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:51.103021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b079d7b2b9044698aa57234f838f416'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.169619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b079d7b2b9044698aa57234f838f416'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.176410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b079d7b2b9044698aa57234f838f416'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.177028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b079d7b2b9044698aa57234f838f416'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.188923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9099bc62-4e0c-421c-8531-34e1db19e849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b079d7b2b9044698aa57234f838f416'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.194737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1155/2301] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:54:50 2022] DELETE /identity/v3/users/3b079d7b2b9044698aa57234f838f416 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:51.428484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:51.429888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:51.442721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea6a55-a8e5-4525-baf4-006a3d11b9b7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:51.500050 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:51.500903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:51.501185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:51.501456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] PATH_INFO: `/v3/projects/f0a6f9fb457143c08c173fa8f82514bf` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:51.502616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a6f9fb457143c08c173fa8f82514bf)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:51.504561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:51.614675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a6f9fb457143c08c173fa8f82514bf', 'request_id': 'req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.620407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a6f9fb457143c08c173fa8f82514bf', 'request_id': 'req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.689311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a6f9fb457143c08c173fa8f82514bf', 'request_id': 'req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.700491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] The token cache is being invalidate because project f0a6f9fb457143c08c173fa8f82514bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:54:51.700781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.701382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-8f6f2796-72cd-48ae-8f80-57ba4e523a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:54:51.702890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1147/2302] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:54:51 2022] DELETE /identity/v3/projects/f0a6f9fb457143c08c173fa8f82514bf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:51.707846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:51.708142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:51.708423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:51.726141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:51.727324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:51.787829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1156/2303] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:51.795954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:51.796235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:51.796510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:51.814249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:51.815437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:51.823779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1148/2304] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:51.828131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:51.838508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5bacc-6dca-4291-b2f8-744a2351aaf3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:51.843262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:51.843960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:51.844247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:51.844527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:51.845250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:54:51.845581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:51.847208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:51.858734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1157/2305] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:54:51.863119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:51.872277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb69e52-560f-4706-9bf2-c64335829dd1 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:51.876931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:51.877573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:51.877855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:51.878130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:51.878820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:51.880755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:51.999987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1149/2306] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:54:51 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:52.004967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.014298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8416e-a881-443e-a861-5541dc849d43 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.069299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.069958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.070831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.071107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.071846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.073778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.170058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1158/2307] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:54:52 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:52.174127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.184928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2faca7-e50e-4392-a96b-a8cf1d673a91 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.189576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.190225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.190503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.190779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.191550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.193178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.203880 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1150/2308] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:52.207661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.217391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ce565-52d8-486f-b215-0be26e3b13cc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.221896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d50c85-fe44-433d-b33d-91e9d8507dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.222531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d50c85-fe44-433d-b33d-91e9d8507dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.222814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d50c85-fe44-433d-b33d-91e9d8507dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.223141 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d50c85-fe44-433d-b33d-91e9d8507dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.223852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d50c85-fe44-433d-b33d-91e9d8507dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.225439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d50c85-fe44-433d-b33d-91e9d8507dc7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.234992 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1159/2309] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:52.238966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.249156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1f0ea-04a2-4425-bfdb-8d1307ddf9bd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.253757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.254620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.254907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.255185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] PATH_INFO: `/v3/projects/a07b3845d35d4fb49abab73b15726797/users/010cfa1fce1e4e9bbdbcfa2e8a65f292/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.270433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07b3845d35d4fb49abab73b15726797, user_id=010cfa1fce1e4e9bbdbcfa2e8a65f292, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.273099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.341234 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1151/2310] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:54:52 2022] PUT /identity/v3/projects/a07b3845d35d4fb49abab73b15726797/users/010cfa1fce1e4e9bbdbcfa2e8a65f292/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:54:52.351521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.351851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.352132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.378637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] MFA Rules not processed for user `010cfa1fce1e4e9bbdbcfa2e8a65f292`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:52.379865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:52.453811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1160/2311] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:52.458673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.518878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16031b4-8ab6-4f7f-b625-930249011f96 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.523488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.524160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.524438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.524710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.525436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.527365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.610665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1152/2312] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:54:52 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:52.614811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.625802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da9165-25be-4bd6-b6d2-fa09ff860286 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.678391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.679037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.679317 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.680224 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.680910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.682815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.895998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1161/2313] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:54:52 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:54:52.900437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.910428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f58b5-f58a-4ce3-b126-b1aea8287cfb admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.915749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.916396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.916675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.916944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.917664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.919257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:52.929485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1153/2314] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:52.933432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:52.943125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9879fd5-213e-4aa7-8bac-c15b4bbe12c5 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:52.947690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:52.948549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:52.948827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:52.949098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] PATH_INFO: `/v3/projects/d08c8d0bbdd6421fb67d4fe0e19e09fc/users/b6473ca5b54a40ddb023db7029c262e9/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:52.963621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08c8d0bbdd6421fb67d4fe0e19e09fc, user_id=b6473ca5b54a40ddb023db7029c262e9, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:52.966782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:53.056309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1162/2315] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:54:52 2022] PUT /identity/v3/projects/d08c8d0bbdd6421fb67d4fe0e19e09fc/users/b6473ca5b54a40ddb023db7029c262e9/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:53.060252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:53.070069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50a2a9-8308-47fb-bd8b-e081d2752062 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:53.124244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bab85-8f79-4657-93d1-e7ddfe07d54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:53.124895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bab85-8f79-4657-93d1-e7ddfe07d54b admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:53.125173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bab85-8f79-4657-93d1-e7ddfe07d54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:53.125444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bab85-8f79-4657-93d1-e7ddfe07d54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:53.126156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bab85-8f79-4657-93d1-e7ddfe07d54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:53.127780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bab85-8f79-4657-93d1-e7ddfe07d54b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:53.137188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1154/2316] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:54:53.141635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:53.152436 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3f6f1-98ce-4fc9-bdff-e5a1a251b8b9 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:53.156927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:53.161443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:53.161443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:53.161443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] PATH_INFO: `/v3/projects/d08c8d0bbdd6421fb67d4fe0e19e09fc/users/b6473ca5b54a40ddb023db7029c262e9/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:53.161443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08c8d0bbdd6421fb67d4fe0e19e09fc, user_id=b6473ca5b54a40ddb023db7029c262e9, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:53.162867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:53.173602 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1163/2317] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:54:53 2022] PUT /identity/v3/projects/d08c8d0bbdd6421fb67d4fe0e19e09fc/users/b6473ca5b54a40ddb023db7029c262e9/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:54:53.185628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:53.185917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:53.186196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:53.212712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] MFA Rules not processed for user `b6473ca5b54a40ddb023db7029c262e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:54:53.213911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:53.278171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1155/2318] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:54:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:54:53.290125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:53.291866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:53.347528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93022d52-352b-47b9-917a-14239f7bbb87 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:53.351073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:53.351819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:53.352101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:53.352373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:53.361125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:53.362533 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:53.371933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1164/2319] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:54:53.571398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:53.580823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ef090-e216-41c0-9d19-52ff0cb1442a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:53.584346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:53.584974 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:53.585257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:53.585526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:53.639204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:53.640662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:53.649342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1156/2320] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:54:58.476326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:54:58.477751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:58.532679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd243e-2172-4990-af7b-7286dd81b7fd service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:54:58.536244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:54:58.536875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:54:58.537157 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:54:58.537429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:54:58.539180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:54:58.548516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:54:58.549920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19894df3-d74d-4617-ad3d-ab39c526e9eb service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:54:58.557532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1165/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:54:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:00.132036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:00.133482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:00.206324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e296603-be9b-4aec-8b3a-8391607def92 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:00.211795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:00.213083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:00.213366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:00.213642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:00.215418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:00.269920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:00.271530 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:00.280808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1157/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:07.403518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:07.404821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:07.404821 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:07.421725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:07.422906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:07.475643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1166/2323] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 22:55:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:07.613964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:07.615370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:07.684289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef99ad-0576-4ce9-97cc-4efd299e0b37 service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:07.689376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:07.690032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:07.690317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:07.690595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:07.699262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:07.700899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:07.708896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1158/2324] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 22:55:16.645227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:16.646645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:16.712132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6d583-fac1-444b-86f9-e66a07551d16 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:16.717051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:16.717912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:16.718197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:16.718474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] PATH_INFO: `/v3/users/c3a3559d3f58433ba7da9869ebd18aea` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:16.719708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a3559d3f58433ba7da9869ebd18aea)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:16.721627 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:16.884838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a3559d3f58433ba7da9869ebd18aea'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:16.946758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a3559d3f58433ba7da9869ebd18aea'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:16.954577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a3559d3f58433ba7da9869ebd18aea'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:16.959188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a3559d3f58433ba7da9869ebd18aea'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:16.966925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a3559d3f58433ba7da9869ebd18aea'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:16.977408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1167/2325] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:55:16 2022] DELETE /identity/v3/users/c3a3559d3f58433ba7da9869ebd18aea => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:17.205746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:17.217608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb9fc0-e5f8-413f-8b98-a5e420a10d12 service swift] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:17.273620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:17.274467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:17.274742 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:17.275008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] PATH_INFO: `/v3/projects/21eb12adce404f178fab98c30fd5aa77` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:17.276241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=21eb12adce404f178fab98c30fd5aa77)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:17.278134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:17.370436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21eb12adce404f178fab98c30fd5aa77', 'request_id': 'req-d57c9a65-bf84-4448-ba4c-649792f745fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.375863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21eb12adce404f178fab98c30fd5aa77', 'request_id': 'req-d57c9a65-bf84-4448-ba4c-649792f745fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.415344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21eb12adce404f178fab98c30fd5aa77', 'request_id': 'req-d57c9a65-bf84-4448-ba4c-649792f745fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.427447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] The token cache is being invalidate because project 21eb12adce404f178fab98c30fd5aa77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:55:17.427694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.428335 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.429847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1159/2326] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:55:17 2022] DELETE /identity/v3/projects/21eb12adce404f178fab98c30fd5aa77 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:17.434626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:17.436074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:17.448798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84748da6-6309-464b-9db9-90d82c6dab99 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:17.503538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:17.504427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:17.504711 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:17.504990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] PATH_INFO: `/v3/users/25b259309ad9453485b420864bb8dc87` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:17.506191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b259309ad9453485b420864bb8dc87)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:17.508172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:17.675178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b259309ad9453485b420864bb8dc87'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.730165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b259309ad9453485b420864bb8dc87'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.737958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b259309ad9453485b420864bb8dc87'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.738748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b259309ad9453485b420864bb8dc87'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.750389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b259309ad9453485b420864bb8dc87'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:17.756290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1168/2327] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:55:17 2022] DELETE /identity/v3/users/25b259309ad9453485b420864bb8dc87 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:17.982132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:17.983548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:17.996319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9a65-bf84-4448-ba4c-649792f745fc admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:18.051721 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:18.052568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:18.052844 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:18.053114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] PATH_INFO: `/v3/projects/ef43bec696814a45965f30ef4b98bfd8` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:18.054264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef43bec696814a45965f30ef4b98bfd8)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:18.056196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:18.185411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef43bec696814a45965f30ef4b98bfd8', 'request_id': 'req-cdfbfb10-4afb-4dfe-8edf-90411796ba05'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:18.190502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef43bec696814a45965f30ef4b98bfd8', 'request_id': 'req-cdfbfb10-4afb-4dfe-8edf-90411796ba05'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:18.266235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef43bec696814a45965f30ef4b98bfd8', 'request_id': 'req-cdfbfb10-4afb-4dfe-8edf-90411796ba05'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:18.277166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] The token cache is being invalidate because project ef43bec696814a45965f30ef4b98bfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:55:18.279193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:18.279193 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:18.279625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1160/2328] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:55:17 2022] DELETE /identity/v3/projects/ef43bec696814a45965f30ef4b98bfd8 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:25.792852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:25.794488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:25.869927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712376-d0b4-4638-a821-1023e25e4b8c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:25.940048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:25.940705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:25.940987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:25.941263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:25.943046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:25.955488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:25.957411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88e7bc-68d7-4a41-a32a-80c17298db93 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:25.968922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1169/2329] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:26.054181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:26.055573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:26.071509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbfb10-4afb-4dfe-8edf-90411796ba05 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:26.076884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:26.077514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:26.077793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:26.078069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:26.079792 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:26.145226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:26.146903 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:26.158220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1161/2330] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:26.911366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:26.911855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:26.911957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:26.929931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:26.940318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:26.987050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1170/2331] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:55:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:27.000680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:27.005051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:27.074008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f275d-1165-4fdc-92b7-fb13652db402 service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:27.079483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c09113-d8cd-4cc0-a5ed-42d37b82533e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:27.080250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c09113-d8cd-4cc0-a5ed-42d37b82533e service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:27.080573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c09113-d8cd-4cc0-a5ed-42d37b82533e service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:27.080831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c09113-d8cd-4cc0-a5ed-42d37b82533e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:27.090046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c09113-d8cd-4cc0-a5ed-42d37b82533e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:27.091938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c09113-d8cd-4cc0-a5ed-42d37b82533e service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:27.102203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1162/2332] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:55:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:55:30.786784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:30.802873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4e6e-b252-466d-835e-a64fbea0de1a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:30.822658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:30.824103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:30.824489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:30.825008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:30.829508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:30.845504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:30.847643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:30.882918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1171/2333] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:36.759661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:36.760139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:36.760243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:36.780046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] MFA Rules not processed for user `b9282b0e5cbb458bb31d462a76832aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:36.785339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:36.863645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1163/2334] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:37.295250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:37.297183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:37.372525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fe531-571d-4e05-9c38-d9ff66dc1074 service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:37.376227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:37.376882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:37.377168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:37.377445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:37.379405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:37.389441 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:37.390636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:37.398851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1172/2335] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:37.843971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:37.845402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:37.926795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1b027-21e3-4f18-961f-cf3dfac5589e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:37.932144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:37.932918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:37.933398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:37.933856 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:37.936059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:37.951985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:37.953805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1fa55-975d-468c-aef2-c6e1e24a3041 service placement] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:37.978812 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1164/2336] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:40.426186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:40.427873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:40.493598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5740a23-6640-4f58-b67b-1db80ab53319 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:40.498252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:40.499171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:40.499452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:40.499783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] PATH_INFO: `/v3/users/010cfa1fce1e4e9bbdbcfa2e8a65f292` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:40.500999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010cfa1fce1e4e9bbdbcfa2e8a65f292)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:40.502927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:40.732467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010cfa1fce1e4e9bbdbcfa2e8a65f292'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:40.809133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010cfa1fce1e4e9bbdbcfa2e8a65f292'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:40.817772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010cfa1fce1e4e9bbdbcfa2e8a65f292'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:40.818480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010cfa1fce1e4e9bbdbcfa2e8a65f292'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:40.832147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010cfa1fce1e4e9bbdbcfa2e8a65f292'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:40.838847 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1173/2337] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:55:40 2022] DELETE /identity/v3/users/010cfa1fce1e4e9bbdbcfa2e8a65f292 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:40.843904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:40.844414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:40.845088 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:40.867816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:40.869486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:40.947451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1165/2338] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:55:40.957330 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:40.960444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:41.020294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2cb16-b505-4493-834b-20cd29cf2453 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:41.024769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:41.025413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:41.025699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:41.025976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:41.035905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:41.037343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:41.047948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1174/2339] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:41.479321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:41.481452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:41.494316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d62913-773b-42d2-bfeb-69a4051ad382 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:41.499231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:41.501989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:41.502277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:41.502561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] PATH_INFO: `/v3/projects/a07b3845d35d4fb49abab73b15726797` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:41.504342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07b3845d35d4fb49abab73b15726797)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:41.506262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:41.598003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07b3845d35d4fb49abab73b15726797', 'request_id': 'req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:41.603681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07b3845d35d4fb49abab73b15726797', 'request_id': 'req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:41.677766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07b3845d35d4fb49abab73b15726797', 'request_id': 'req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:41.689021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] The token cache is being invalidate because project a07b3845d35d4fb49abab73b15726797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:55:41.689305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:41.689916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:41.691455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1166/2340] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:55:41 2022] DELETE /identity/v3/projects/a07b3845d35d4fb49abab73b15726797 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:41.695353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:41.704930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a76a7-06ea-408f-b942-d36297736b7c service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:41.758024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:41.758800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:41.759078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:41.759356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] PATH_INFO: `/v3/users/b6473ca5b54a40ddb023db7029c262e9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:41.760542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6473ca5b54a40ddb023db7029c262e9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:41.762445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:41.936927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6473ca5b54a40ddb023db7029c262e9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.003762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6473ca5b54a40ddb023db7029c262e9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.012181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6473ca5b54a40ddb023db7029c262e9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.012867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6473ca5b54a40ddb023db7029c262e9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.024508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9767a847-378c-4bb4-8fb8-b406bb1ee732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6473ca5b54a40ddb023db7029c262e9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.031155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1175/2341] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:55:41 2022] DELETE /identity/v3/users/b6473ca5b54a40ddb023db7029c262e9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:42.531490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:42.533152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:42.546394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca32e9-2fd5-46e0-8ba2-2642a63ceea8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:42.607180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:42.608127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:42.608414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:42.608691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] PATH_INFO: `/v3/projects/d08c8d0bbdd6421fb67d4fe0e19e09fc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:42.609924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08c8d0bbdd6421fb67d4fe0e19e09fc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:42.611878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:42.752630 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08c8d0bbdd6421fb67d4fe0e19e09fc', 'request_id': 'req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.762137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08c8d0bbdd6421fb67d4fe0e19e09fc', 'request_id': 'req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.838329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08c8d0bbdd6421fb67d4fe0e19e09fc', 'request_id': 'req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.852461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] The token cache is being invalidate because project d08c8d0bbdd6421fb67d4fe0e19e09fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:55:42.853143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.854106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b50e1fd0-fed5-4dfa-bd13-4d0f239f57dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:42.856210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1167/2342] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:55:42 2022] DELETE /identity/v3/projects/d08c8d0bbdd6421fb67d4fe0e19e09fc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:42.864951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:42.864951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:42.864951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:42.885155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:42.886402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:42.947281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1176/2343] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:42.955668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:42.956032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:42.956379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:42.975385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:42.976712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:42.985160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1168/2344] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:55:42.989255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:42.999713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c832a6-2763-4939-8605-59bba0b94751 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.004370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.005015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.005303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.005579 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.006304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:55:43.006609 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.008234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.019915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1177/2345] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:55:43.024155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.033361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc894c70-9b11-47ff-bc15-2c434de39f47 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.037895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.038535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.038814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.039086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.039809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.041964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.156106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1169/2346] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:55:43 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:55:43.160368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.171355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a750c38-d66d-45b1-9769-527485d1783e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.254923 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.255636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.255927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.256247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.257133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.259147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.352450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1178/2347] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:55:43 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:55:43.357210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.367711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34926efc-7161-40cd-95ab-4fb397eaebf7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.376076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.376076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.376076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.376076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.377018 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.378801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.391970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1170/2348] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:43.395135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.408560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab95da-7bc9-4f90-b748-2dbd72190450 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.416703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dcd89-e232-4776-9632-8622bb79eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.418186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dcd89-e232-4776-9632-8622bb79eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.419280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dcd89-e232-4776-9632-8622bb79eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.420132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dcd89-e232-4776-9632-8622bb79eeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.421103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dcd89-e232-4776-9632-8622bb79eeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.422728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dcd89-e232-4776-9632-8622bb79eeb8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.435884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1179/2349] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:43.440743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.456871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5238b1-bfb1-4918-b730-98894f1adeab admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.462399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.465947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.465947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.465947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] PATH_INFO: `/v3/projects/61ae5429a4a74484a855ad566f14d6b6/users/e8f7f5aac41b4e5dbd12a06d08764625/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.480584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ae5429a4a74484a855ad566f14d6b6, user_id=e8f7f5aac41b4e5dbd12a06d08764625, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.483401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.554996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1171/2350] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:55:43 2022] PUT /identity/v3/projects/61ae5429a4a74484a855ad566f14d6b6/users/e8f7f5aac41b4e5dbd12a06d08764625/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:43.566926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.569227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.569227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.607093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] MFA Rules not processed for user `e8f7f5aac41b4e5dbd12a06d08764625`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:43.609077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:43.681326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1180/2351] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:43.686406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.752597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15096f-85de-4ee2-833a-4c037e6b9565 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.759959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.760641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.765481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.765481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.765481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.765481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:43.872235 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1172/2352] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:55:43 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:55:43.873324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:43.884569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63f8eb-ddc4-4257-bb52-c0b270a7c495 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:43.954639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:43.955321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:43.955623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:43.955912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:43.956641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:43.958571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:44.057840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1181/2353] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:55:43 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:55:44.061759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:44.073076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914893ff-a90c-46e9-a9fb-743b70543222 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:44.078691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:44.079348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:44.079670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:44.079989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:44.080710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:44.082296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:44.093778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1173/2354] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:44.098118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:44.108361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818a69-28ec-425b-ac02-40d5ca412857 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:44.113138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:44.114016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:44.114297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:44.114625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] PATH_INFO: `/v3/projects/1da168f907d9418aad23c1fcfddfd92b/users/0b71fab6795f4fc7a76de40ac542a78e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:44.135703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da168f907d9418aad23c1fcfddfd92b, user_id=0b71fab6795f4fc7a76de40ac542a78e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:44.135703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:44.209322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1182/2355] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:55:44 2022] PUT /identity/v3/projects/1da168f907d9418aad23c1fcfddfd92b/users/0b71fab6795f4fc7a76de40ac542a78e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:55:44.213293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:44.223753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65340b-45d2-49ff-9611-c07a92646d66 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:44.278411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec851c69-8eac-43a6-957f-f36430e85fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:44.279127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851c69-8eac-43a6-957f-f36430e85fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:44.279408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851c69-8eac-43a6-957f-f36430e85fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:44.279708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851c69-8eac-43a6-957f-f36430e85fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:44.280434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec851c69-8eac-43a6-957f-f36430e85fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:44.282117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec851c69-8eac-43a6-957f-f36430e85fb3 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:44.291912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1174/2356] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:44.296166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:44.306286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792aaaa-6b9e-45b0-9128-579e6448c5d8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:44.310899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:44.311808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:44.312091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:44.312367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] PATH_INFO: `/v3/projects/1da168f907d9418aad23c1fcfddfd92b/users/0b71fab6795f4fc7a76de40ac542a78e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:44.314427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da168f907d9418aad23c1fcfddfd92b, user_id=0b71fab6795f4fc7a76de40ac542a78e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:44.317164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:44.329538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1183/2357] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:55:44 2022] PUT /identity/v3/projects/1da168f907d9418aad23c1fcfddfd92b/users/0b71fab6795f4fc7a76de40ac542a78e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:44.339662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5dd86-5b09-424c-b7d8-9cc72744dc1b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:44.340573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5dd86-5b09-424c-b7d8-9cc72744dc1b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:44.340854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5dd86-5b09-424c-b7d8-9cc72744dc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:44.369807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a2a5dd86-5b09-424c-b7d8-9cc72744dc1b None None] MFA Rules not processed for user `0b71fab6795f4fc7a76de40ac542a78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:44.371776 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a2a5dd86-5b09-424c-b7d8-9cc72744dc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:44.442376 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1175/2358] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:55:44.454707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:44.456424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:44.513101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a252-7cf9-4d58-a0aa-569a2e05888f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:44.516852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445134-04bf-45b4-ab63-31b42aa2c21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:44.517568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445134-04bf-45b4-ab63-31b42aa2c21f service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:44.517984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445134-04bf-45b4-ab63-31b42aa2c21f service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:44.518333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445134-04bf-45b4-ab63-31b42aa2c21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:44.529167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445134-04bf-45b4-ab63-31b42aa2c21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:44.530592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445134-04bf-45b4-ab63-31b42aa2c21f service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:44.539928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1184/2359] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:45.344184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7255-2988-4060-8695-d67be8e776f7 None None] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.345052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7255-2988-4060-8695-d67be8e776f7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.345328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c7255-2988-4060-8695-d67be8e776f7 None None] PATH_INFO: `/` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.346695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1176/2360] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:55:45.352560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.352968 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.353107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.374088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:45.375310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:45.449038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1185/2361] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:55:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:45.460871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7255-2988-4060-8695-d67be8e776f7 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:45.467148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:45.468573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:45.523469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cebe22-6b5c-4462-b02d-93f8cd3f5001 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:45.525351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c7255-2988-4060-8695-d67be8e776f7 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:45.527775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d8036-b3c5-4d6f-bc57-b6edf595ca31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:45.528409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8036-b3c5-4d6f-bc57-b6edf595ca31 service glance] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.528687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8036-b3c5-4d6f-bc57-b6edf595ca31 service glance] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.529010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d8036-b3c5-4d6f-bc57-b6edf595ca31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.530525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:45.531381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.531693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.531975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] PATH_INFO: `/v3/users/e8f7f5aac41b4e5dbd12a06d08764625` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.533178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8f7f5aac41b4e5dbd12a06d08764625)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:45.535110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:45.539183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d8036-b3c5-4d6f-bc57-b6edf595ca31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:45.540867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d8036-b3c5-4d6f-bc57-b6edf595ca31 service glance] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:45.552417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1186/2362] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:55:45.737877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8f7f5aac41b4e5dbd12a06d08764625'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:45.761308 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6f12-0892-4e89-b80c-f9d3816076d7 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.762057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6f12-0892-4e89-b80c-f9d3816076d7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.762496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6f12-0892-4e89-b80c-f9d3816076d7 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.764048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1187/2363] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:55:45.770614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.770984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.771271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.790204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] MFA Rules not processed for user `843f6ae9b5864f00bfea0ea2ab02d552`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:45.791612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:45.810183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8f7f5aac41b4e5dbd12a06d08764625'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:45.818480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8f7f5aac41b4e5dbd12a06d08764625'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:45.822756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8f7f5aac41b4e5dbd12a06d08764625'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:45.822756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d817dcf-6ec9-4a53-8529-bde07919eb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8f7f5aac41b4e5dbd12a06d08764625'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:45.837963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1177/2364] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:55:45 2022] DELETE /identity/v3/users/e8f7f5aac41b4e5dbd12a06d08764625 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:45.842735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.843034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.843320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.863739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:45.864961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:45.867343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1188/2365] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:55:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:55:45.881952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:45.883503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:45.894430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a07e3d-2d60-4327-833d-9911f8e2b557 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:45.942173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1178/2366] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:45.955625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:45.961012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9857fb-4a37-4a71-86b8-8e9960905911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:45.961658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9857fb-4a37-4a71-86b8-8e9960905911 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:45.962456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9857fb-4a37-4a71-86b8-8e9960905911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:45.962834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9857fb-4a37-4a71-86b8-8e9960905911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:45.971149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9857fb-4a37-4a71-86b8-8e9960905911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:45.972690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9857fb-4a37-4a71-86b8-8e9960905911 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:45.981839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1189/2367] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:46.009435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666d055-558b-4b05-bba8-6f463c480bd9 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:46.014589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee36bb5-b43e-4e36-8487-aabd12a1ee10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:46.015242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee36bb5-b43e-4e36-8487-aabd12a1ee10 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:46.015528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee36bb5-b43e-4e36-8487-aabd12a1ee10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:46.015841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee36bb5-b43e-4e36-8487-aabd12a1ee10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:46.025217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee36bb5-b43e-4e36-8487-aabd12a1ee10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:46.026662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee36bb5-b43e-4e36-8487-aabd12a1ee10 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:46.037209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1179/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:55:46.070856 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34f51-45bd-4a6e-9c78-5e39c6c84624 None None] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:46.075688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34f51-45bd-4a6e-9c78-5e39c6c84624 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:46.075688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff34f51-45bd-4a6e-9c78-5e39c6c84624 None None] PATH_INFO: `/` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:46.075688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1190/2369] 10.222.0.23 () {54 vars in 921 bytes} [Tue May 3 22:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 03 22:55:46.079664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:46.080035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:46.080383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:46.100419 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] MFA Rules not processed for user `6d0846a688aa48a9a69fcb730dc5d7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:46.101645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:46.170171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1180/2370] 10.222.0.23 () {58 vars in 1018 bytes} [Tue May 3 22:55:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:46.180764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff34f51-45bd-4a6e-9c78-5e39c6c84624 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:46.191544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff34f51-45bd-4a6e-9c78-5e39c6c84624 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:46.195233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:46.195919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:46.196201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:46.196497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:46.206593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:46.208138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:46.219420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1191/2371] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:46.517454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:46.518931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:46.533020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8f44-8009-468e-b1ca-d713e4dc5e00 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:46.538081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:46.539082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:46.539213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:46.539696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] PATH_INFO: `/v3/projects/61ae5429a4a74484a855ad566f14d6b6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:46.542327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ae5429a4a74484a855ad566f14d6b6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:46.544544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:46.667001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ae5429a4a74484a855ad566f14d6b6', 'request_id': 'req-2f79875f-1c9f-45d5-97c0-4a4100feb41d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:46.674318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ae5429a4a74484a855ad566f14d6b6', 'request_id': 'req-2f79875f-1c9f-45d5-97c0-4a4100feb41d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:46.734928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ae5429a4a74484a855ad566f14d6b6', 'request_id': 'req-2f79875f-1c9f-45d5-97c0-4a4100feb41d'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:46.746973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] The token cache is being invalidate because project 61ae5429a4a74484a855ad566f14d6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:55:46.747260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:46.747895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:46.749425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1181/2372] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:55:46 2022] DELETE /identity/v3/projects/61ae5429a4a74484a855ad566f14d6b6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:46.753466 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:46.765454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92772d5b-fc0d-4558-b2b7-d2eac2308fac service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:46.819892 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:46.820673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:46.820953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:46.821228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] PATH_INFO: `/v3/users/0b71fab6795f4fc7a76de40ac542a78e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:46.822395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b71fab6795f4fc7a76de40ac542a78e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:46.824382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:46.999495 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b71fab6795f4fc7a76de40ac542a78e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.060737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b71fab6795f4fc7a76de40ac542a78e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.070310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b71fab6795f4fc7a76de40ac542a78e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.070674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b71fab6795f4fc7a76de40ac542a78e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.084494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-aaf4d08b-1aea-45d7-9530-20ddc2aed504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b71fab6795f4fc7a76de40ac542a78e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.093028 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1192/2373] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:55:46 2022] DELETE /identity/v3/users/0b71fab6795f4fc7a76de40ac542a78e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:47.536112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:47.537680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:47.552969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79875f-1c9f-45d5-97c0-4a4100feb41d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:47.613891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:47.614751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:47.615031 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:47.615306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] PATH_INFO: `/v3/projects/1da168f907d9418aad23c1fcfddfd92b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:47.616519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da168f907d9418aad23c1fcfddfd92b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:47.618483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:47.728520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da168f907d9418aad23c1fcfddfd92b', 'request_id': 'req-846c8895-f2c7-4e12-a73a-150fbc60df75'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.734937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da168f907d9418aad23c1fcfddfd92b', 'request_id': 'req-846c8895-f2c7-4e12-a73a-150fbc60df75'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.820984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da168f907d9418aad23c1fcfddfd92b', 'request_id': 'req-846c8895-f2c7-4e12-a73a-150fbc60df75'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.835654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] The token cache is being invalidate because project 1da168f907d9418aad23c1fcfddfd92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:55:47.836381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.837465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-846c8895-f2c7-4e12-a73a-150fbc60df75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:55:47.846036 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1182/2374] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:55:47 2022] DELETE /identity/v3/projects/1da168f907d9418aad23c1fcfddfd92b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:47.847871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:47.847871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:47.848412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:47.890676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:47.891951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:47.979507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1193/2375] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:55:47.988943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:47.989230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:47.989510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.009690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:48.011081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:48.020120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1183/2376] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:48.024309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.035024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8aef6-adf6-48fc-bda7-dba7d60ef0fa None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.041738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.042657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.043460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.043880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.044636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:55:48.044944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.046554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.065204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.071877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1194/2377] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:55:48.077098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212d63-e549-4b18-8e27-47509325a0d7 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.082142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.082986 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.083273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.083550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.086023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.088237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.228310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1184/2378] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:55:48 2022] POST /identity/v3/projects => generated 353 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:55:48.233105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.252978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3e994-83b7-45ad-a13e-dc1cec78b7fa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.342137 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.343135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.343415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.344208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.344718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.347454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.415176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1195/2379] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:55:48 2022] POST /identity/v3/users => generated 277 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:55:48.420129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.430135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30461fa8-58ce-4e22-9a21-007b8b396499 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.435816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.436490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.436769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.437042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.437770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.439387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.450167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1185/2380] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:48.454179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.464234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf890b-6c53-467c-ac37-cabd13a1465e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.468823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5418e-f185-49ed-a76a-4370058212c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.469469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5418e-f185-49ed-a76a-4370058212c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.469753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5418e-f185-49ed-a76a-4370058212c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.470025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5418e-f185-49ed-a76a-4370058212c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.470744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5418e-f185-49ed-a76a-4370058212c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.473684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5418e-f185-49ed-a76a-4370058212c0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.482355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1196/2381] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:48.486327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.496527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a636c62-ca3b-4005-97dd-0d8dba3992eb admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.501151 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.502016 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.502296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.502572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] PATH_INFO: `/v3/projects/65be5504723a44f79d4eddea6933ed20/users/3d0da2ff84ab4352baf0d956ec4e8019/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.518359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65be5504723a44f79d4eddea6933ed20, user_id=3d0da2ff84ab4352baf0d956ec4e8019, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.521035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.586378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1186/2382] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:55:48 2022] PUT /identity/v3/projects/65be5504723a44f79d4eddea6933ed20/users/3d0da2ff84ab4352baf0d956ec4e8019/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:48.596542 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.596831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.597112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.625758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] MFA Rules not processed for user `3d0da2ff84ab4352baf0d956ec4e8019`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:48.626947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:48.692212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1197/2383] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:48 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:55:48.696554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.760586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46919168-9316-4224-af8b-01c3931bf90c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.765949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.767208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.767208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.767433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.768122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.770096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.835520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1187/2384] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:55:48 2022] POST /identity/v3/projects => generated 357 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:55:48.836877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:48.847927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e798d78-bfe9-47a5-85b1-9dac21b3854b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:48.904129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:48.905062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:48.905342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:48.905616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:48.906302 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:48.908281 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:48.986772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1198/2385] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:55:48 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:55:48.990657 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.000989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc26c6-5b64-4ee3-9809-8021a2848b05 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.005729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.006379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.006664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.006943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.007771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.009358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.019782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1188/2386] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:55:49.023523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.033778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6f148-d602-4b24-aa7f-b572db3c741e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.038388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.039263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.039546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.039857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] PATH_INFO: `/v3/projects/0e7e369d55004af0926a8967b9c234f4/users/c972a322258f4affb99aa75db2151ebd/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.061870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7e369d55004af0926a8967b9c234f4, user_id=c972a322258f4affb99aa75db2151ebd, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.064576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.140619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1199/2387] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:55:49 2022] PUT /identity/v3/projects/0e7e369d55004af0926a8967b9c234f4/users/c972a322258f4affb99aa75db2151ebd/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:55:49.144480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.154832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed7327-5d1c-4ced-b63d-890907a53512 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.209142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e393f0f-919a-43d2-bc41-09943de48f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.209850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e393f0f-919a-43d2-bc41-09943de48f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.210128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e393f0f-919a-43d2-bc41-09943de48f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.210396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e393f0f-919a-43d2-bc41-09943de48f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.211108 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e393f0f-919a-43d2-bc41-09943de48f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.212775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e393f0f-919a-43d2-bc41-09943de48f41 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.222731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1189/2388] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:55:49.227023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.237791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40016932-b494-4922-bbc0-aa8bdcbdbdc6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.242644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be2dab-a612-4ea7-9661-f79941be4d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.243516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2dab-a612-4ea7-9661-f79941be4d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.243833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2dab-a612-4ea7-9661-f79941be4d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.244107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be2dab-a612-4ea7-9661-f79941be4d3a admin admin] PATH_INFO: `/v3/projects/0e7e369d55004af0926a8967b9c234f4/users/c972a322258f4affb99aa75db2151ebd/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.246160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2dab-a612-4ea7-9661-f79941be4d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7e369d55004af0926a8967b9c234f4, user_id=c972a322258f4affb99aa75db2151ebd, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.248850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be2dab-a612-4ea7-9661-f79941be4d3a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.268606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1200/2389] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:55:49 2022] PUT /identity/v3/projects/0e7e369d55004af0926a8967b9c234f4/users/c972a322258f4affb99aa75db2151ebd/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:55:49.268704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.268704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.268704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.270771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.271059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.271334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.286497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:49.287717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:49.299630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] MFA Rules not processed for user `c972a322258f4affb99aa75db2151ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:55:49.300815 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:49.344142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1190/2390] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:55:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:49.356841 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.358407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:49.375456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1201/2391] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:55:49 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:55:49.388131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.390319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:49.447155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6ca05-5bff-4897-bf16-c9d1435f9ecd None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.453742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e479f4-6917-48e1-bcf3-c59f7f40ebed None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.454368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.454978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.455260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.455534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.457779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.458614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.459255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.459696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.465465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.467112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.471285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.473454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.478961 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1191/2392] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 03 22:55:49.484241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1202/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:55:49.686116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:49.688655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:49.703667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92144fd5-4151-4667-afb2-6a6ce3e17015 service swift] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:49.719900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:49.720607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:49.720901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:49.723886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:49.830116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:49.831960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:49.846703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1192/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:49 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:55:57.716940 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:55:57.718437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:57.796242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccfccd-a05d-4083-8d64-a0cb18921e35 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:55:57.801870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:55:57.802525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:55:57.803936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:55:57.804250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:55:57.806091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:55:57.868337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:55:57.869922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc8b2e-d774-4881-9239-3acd5c48c8d3 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:55:57.880146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1203/2395] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:55:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:00.659398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:00.660928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:00.678749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707a944-a18c-4c2d-82ce-0a0b3a983b9b service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:00.685014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:00.685859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:00.686312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:00.686755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:00.688847 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:00.702564 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:00.704128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:00.716133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1193/2396] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:06.253647 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:06.254139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:06.254233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:06.273354 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:06.274617 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:06.282439 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1204/2397] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 22:56:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:06.303373 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:06.316765 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccbcb9-2fb6-4c41-80e6-bbbb265748e3 service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:06.323021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9e42-4158-4f1c-88f6-5f6fce8382ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:06.324294 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9e42-4158-4f1c-88f6-5f6fce8382ba service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:06.324560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9e42-4158-4f1c-88f6-5f6fce8382ba service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:06.324835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9e42-4158-4f1c-88f6-5f6fce8382ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:06.333605 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9e42-4158-4f1c-88f6-5f6fce8382ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:06.335190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9e42-4158-4f1c-88f6-5f6fce8382ba service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:06.347842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1194/2398] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:56:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:56:09.239622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:09.300219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7a7de-1d5d-488a-9584-a5af2e2e76b3 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:09.304743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:09.305598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:09.305879 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:09.306152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] PATH_INFO: `/v3/users/3d0da2ff84ab4352baf0d956ec4e8019` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:09.307312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0da2ff84ab4352baf0d956ec4e8019)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:09.309255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:09.484673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0da2ff84ab4352baf0d956ec4e8019'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:09.546185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0da2ff84ab4352baf0d956ec4e8019'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:09.553431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0da2ff84ab4352baf0d956ec4e8019'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:09.554084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0da2ff84ab4352baf0d956ec4e8019'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:09.566091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0da2ff84ab4352baf0d956ec4e8019'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:09.571895 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1205/2399] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:09 2022] DELETE /identity/v3/users/3d0da2ff84ab4352baf0d956ec4e8019 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:09.576615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:09.577089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:09.578330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:09.598352 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:09.599816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:09.658213 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1195/2400] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:09.668737 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:09.670818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:09.728668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634fd0f-a1d1-4f07-83ba-589784d61ef3 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:09.732814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:09.733449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:09.733730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:09.734006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:09.742811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:09.744205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:09.754070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1206/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:56:10.101384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:10.102835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:10.115838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080c9c4-831f-4d7f-8b57-5e3ce1bff2b2 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:10.120676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:10.121537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:10.121834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:10.122085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] PATH_INFO: `/v3/projects/65be5504723a44f79d4eddea6933ed20` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:10.123266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65be5504723a44f79d4eddea6933ed20)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:10.125242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:10.207473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65be5504723a44f79d4eddea6933ed20', 'request_id': 'req-68137911-261b-4aa7-b49c-8b3fad20930a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.212688 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65be5504723a44f79d4eddea6933ed20', 'request_id': 'req-68137911-261b-4aa7-b49c-8b3fad20930a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.276749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65be5504723a44f79d4eddea6933ed20', 'request_id': 'req-68137911-261b-4aa7-b49c-8b3fad20930a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.287987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] The token cache is being invalidate because project 65be5504723a44f79d4eddea6933ed20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:10.288269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.288882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.290402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1196/2402] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:10 2022] DELETE /identity/v3/projects/65be5504723a44f79d4eddea6933ed20 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:10.294717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:10.304395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94e521-a00e-473d-a1fa-d43a28949822 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:10.358850 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:10.359738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:10.360021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:10.360298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] PATH_INFO: `/v3/users/c972a322258f4affb99aa75db2151ebd` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:10.361486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c972a322258f4affb99aa75db2151ebd)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:10.363392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:10.501457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c972a322258f4affb99aa75db2151ebd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.551621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c972a322258f4affb99aa75db2151ebd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.558978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c972a322258f4affb99aa75db2151ebd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.559677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c972a322258f4affb99aa75db2151ebd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.571154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c972a322258f4affb99aa75db2151ebd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:10.577568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1207/2403] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:10 2022] DELETE /identity/v3/users/c972a322258f4affb99aa75db2151ebd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:10.723012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:10.726557 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:10.785941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68137911-261b-4aa7-b49c-8b3fad20930a admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:10.836963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:10.837611 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:10.837893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:10.838318 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:10.840147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:10.921875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:10.923418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa63d-e4e6-4237-89ef-2fde4fd291a9 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:10.936109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1197/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:10.954409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:10.955965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:10.973817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e68835-2a18-4027-9d4e-5aa3957331e0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:10.979789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:10.980669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:10.980960 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:10.981240 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] PATH_INFO: `/v3/projects/0e7e369d55004af0926a8967b9c234f4` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:10.987142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7e369d55004af0926a8967b9c234f4)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:10.989228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.113632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7e369d55004af0926a8967b9c234f4', 'request_id': 'req-d59d8153-341a-40a7-af2b-f6870b341e55'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:11.119500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7e369d55004af0926a8967b9c234f4', 'request_id': 'req-d59d8153-341a-40a7-af2b-f6870b341e55'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:11.191707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7e369d55004af0926a8967b9c234f4', 'request_id': 'req-d59d8153-341a-40a7-af2b-f6870b341e55'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:11.203538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] The token cache is being invalidate because project 0e7e369d55004af0926a8967b9c234f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:11.203858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:11.204526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d59d8153-341a-40a7-af2b-f6870b341e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:11.210418 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1208/2405] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:10 2022] DELETE /identity/v3/projects/0e7e369d55004af0926a8967b9c234f4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:11.212273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.212674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.213059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.232552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:11.233756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:11.292988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1198/2406] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:11.302531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f936-4481-4411-be53-1301ed648867 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.303113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f936-4481-4411-be53-1301ed648867 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.303113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1f936-4481-4411-be53-1301ed648867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.322936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-67f1f936-4481-4411-be53-1301ed648867 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:11.324188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-67f1f936-4481-4411-be53-1301ed648867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:11.334611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1209/2407] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:11.338654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.348811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09d17-d8cb-4ee1-92ad-721f7c05e1e6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:11.353442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:11.354099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.354380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.354653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.355379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:11.355722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:11.357883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.370263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1199/2408] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:56:11.375148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1f936-4481-4411-be53-1301ed648867 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.384400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1f936-4481-4411-be53-1301ed648867 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:11.389077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:11.389925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.390207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.390484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.391174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:11.393110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.465421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1210/2409] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:11 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:11.467462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.478445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782fa7-a114-4e21-8624-a5e3ee9e98e3 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:11.554906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:11.555592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.555904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.556187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.556888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:11.558821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.629777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1200/2410] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:11 2022] POST /identity/v3/users => generated 281 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:11.631134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.642485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696322c1-5e95-440c-9114-44c95e5ce320 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:11.647416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:11.648209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.648561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.648907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.649862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:11.651545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.663918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1211/2411] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:11.668300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.679449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3405706-dc2d-4849-9656-c7874f6d3b2e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:11.684251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796819f-2934-45e1-8898-9f132e5ed9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:11.685114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796819f-2934-45e1-8898-9f132e5ed9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.685466 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796819f-2934-45e1-8898-9f132e5ed9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.685808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796819f-2934-45e1-8898-9f132e5ed9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.686611 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796819f-2934-45e1-8898-9f132e5ed9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:11.688333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796819f-2934-45e1-8898-9f132e5ed9eb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.701640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1201/2412] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:56:11.703119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.713093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9caee58-679c-4e00-bb41-c1f9a5a88691 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:11.718465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:11.719339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.719677 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.719956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] PATH_INFO: `/v3/projects/b021da5a25314c82ab86031b7ae11115/users/2ca4df864d43486fbbe6bdfa8e428cfe/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.735265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b021da5a25314c82ab86031b7ae11115, user_id=2ca4df864d43486fbbe6bdfa8e428cfe, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:11.739408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:11.803686 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1212/2413] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:11 2022] PUT /identity/v3/projects/b021da5a25314c82ab86031b7ae11115/users/2ca4df864d43486fbbe6bdfa8e428cfe/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:11.813934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:11.814499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:11.815096 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:11.842090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] MFA Rules not processed for user `2ca4df864d43486fbbe6bdfa8e428cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:11.843286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:11.906299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1202/2414] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:11.944575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:11.946238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:12.010994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25958e-260e-4696-a1f3-022abce84971 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:12.015109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a8f8a-3c48-40f8-b06a-c99df216f54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:12.015797 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a8f8a-3c48-40f8-b06a-c99df216f54a service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:12.016174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a8f8a-3c48-40f8-b06a-c99df216f54a service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:12.016374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a8f8a-3c48-40f8-b06a-c99df216f54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:12.025004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a8f8a-3c48-40f8-b06a-c99df216f54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:12.026435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a8f8a-3c48-40f8-b06a-c99df216f54a service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:12.037241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1213/2415] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:12.051578 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:12.121810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2f209-5f12-42ba-bb92-a9e2ebbfff28 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:12.127135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:12.128041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:12.128326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:12.128602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] PATH_INFO: `/v3/users/2ca4df864d43486fbbe6bdfa8e428cfe` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:12.129981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca4df864d43486fbbe6bdfa8e428cfe)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:12.132082 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:12.322156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca4df864d43486fbbe6bdfa8e428cfe'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:12.380371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca4df864d43486fbbe6bdfa8e428cfe'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:12.389869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca4df864d43486fbbe6bdfa8e428cfe'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:12.389869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca4df864d43486fbbe6bdfa8e428cfe'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:12.389869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca4df864d43486fbbe6bdfa8e428cfe'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:12.407032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1203/2416] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:12 2022] DELETE /identity/v3/users/2ca4df864d43486fbbe6bdfa8e428cfe => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:12.411494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:12.411995 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:12.412127 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:12.429642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:12.430838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:12.498255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1214/2417] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:12.507865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:12.509269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:12.565544 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74730-9885-40d9-8805-fb236904b5c7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:12.569268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b7525-0c60-4c16-a6c1-419a811295cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:12.569908 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b7525-0c60-4c16-a6c1-419a811295cb service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:12.570190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b7525-0c60-4c16-a6c1-419a811295cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:12.570462 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b7525-0c60-4c16-a6c1-419a811295cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:12.580134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b7525-0c60-4c16-a6c1-419a811295cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:12.581608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b7525-0c60-4c16-a6c1-419a811295cb service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:12.590927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1204/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:13.010687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.012242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:13.037247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2b9d4-e4b9-4ff0-890f-8ab101e715cd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.042570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.043757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.044132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.044593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] PATH_INFO: `/v3/projects/b021da5a25314c82ab86031b7ae11115` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.046771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b021da5a25314c82ab86031b7ae11115)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.048913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.165147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b021da5a25314c82ab86031b7ae11115', 'request_id': 'req-7a6faf0e-bde0-46ac-a7f7-19036e21c610'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:13.171370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b021da5a25314c82ab86031b7ae11115', 'request_id': 'req-7a6faf0e-bde0-46ac-a7f7-19036e21c610'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:13.231964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b021da5a25314c82ab86031b7ae11115', 'request_id': 'req-7a6faf0e-bde0-46ac-a7f7-19036e21c610'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:13.244335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] The token cache is being invalidate because project b021da5a25314c82ab86031b7ae11115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:13.244965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:13.245947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7a6faf0e-bde0-46ac-a7f7-19036e21c610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:13.248864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1215/2419] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:13 2022] DELETE /identity/v3/projects/b021da5a25314c82ab86031b7ae11115 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:13.253560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.254461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.254748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.273452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:13.274947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:13.337686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1205/2420] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:13.345758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.346050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.346350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.370846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:13.372238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:13.381834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1216/2421] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:13.386307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.398345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f98b6-c842-489e-ba64-6acf3530f120 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.403451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.404426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.404863 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.405286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.406450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:13.407109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.409543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.426214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1206/2422] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:13.431381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.448272 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367c8c7-da9f-41fe-b7eb-4955c8e560fa None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.453416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.454314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.455144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.455624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.456683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.458771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.530580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1217/2423] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:13 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:13.534586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.545842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d97398-1bcd-491f-9895-016ccbb71af1 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.602412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.603081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.603361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.603666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.604350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.606257 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.666355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1207/2424] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:13 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:13.677180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.687817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa358cf-5878-43ce-9db3-e25a20470c1a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.692456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.693105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.693389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.693667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.694397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.696110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.706474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1218/2425] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:13.710363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.720785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f2b4d-d6a5-41bc-bcbd-d0cbbcdcddce admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.725423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb85fe1-f218-4a5b-9639-3110af798deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.726111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb85fe1-f218-4a5b-9639-3110af798deb admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.726387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb85fe1-f218-4a5b-9639-3110af798deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.726655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb85fe1-f218-4a5b-9639-3110af798deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.727378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb85fe1-f218-4a5b-9639-3110af798deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.729014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb85fe1-f218-4a5b-9639-3110af798deb admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.740877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1208/2426] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:13.744785 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:13.754525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5b838-774d-4510-8d8c-fb324a67e202 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:13.759067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:13.759962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.760250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.760505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] PATH_INFO: `/v3/projects/7c1d4a93256c4a1ca76d7781d1da0b30/users/42f68286e2014a7889940bbbedf622cd/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.775333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1d4a93256c4a1ca76d7781d1da0b30, user_id=42f68286e2014a7889940bbbedf622cd, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:13.778013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:13.872501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1219/2427] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:13 2022] PUT /identity/v3/projects/7c1d4a93256c4a1ca76d7781d1da0b30/users/42f68286e2014a7889940bbbedf622cd/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:13.883542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:13.883859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:13.884154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:13.914510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] MFA Rules not processed for user `42f68286e2014a7889940bbbedf622cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:13.914510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:13.990370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1209/2428] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:14.000320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:14.002929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:14.078724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5ff5f-6399-482e-b2ef-9a5b6f9ef09c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:14.081924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:14.082625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:14.082911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:14.083321 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:14.098755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:14.100243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:14.116594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1220/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:14.667238 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:14.668728 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:14.743801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e13d-1bb0-4b92-af8a-14ea11fdb844 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:14.749065 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:14.753386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:14.753386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:14.753386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] PATH_INFO: `/v3/users/dd0ac9313e0149bbaabbcbeaa35b1d01` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:14.753386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0ac9313e0149bbaabbcbeaa35b1d01)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:14.753750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:14.884782 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0ac9313e0149bbaabbcbeaa35b1d01'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:14.957719 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0ac9313e0149bbaabbcbeaa35b1d01'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:14.966995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0ac9313e0149bbaabbcbeaa35b1d01'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:14.967667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0ac9313e0149bbaabbcbeaa35b1d01'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:14.971904 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-81a75665-6c12-471c-a731-bb6cad88e474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0ac9313e0149bbaabbcbeaa35b1d01'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:14.991040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1210/2430] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:14 2022] DELETE /identity/v3/users/dd0ac9313e0149bbaabbcbeaa35b1d01 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:15.217051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.228882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a4008-4fc6-4ae4-bb6a-f22aea4918a8 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.285661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.286527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.286810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.287085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] PATH_INFO: `/v3/projects/cd0e2add97d14fe98880b55132c9f16f` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.288289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0e2add97d14fe98880b55132c9f16f)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:15.290215 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:15.409065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0e2add97d14fe98880b55132c9f16f', 'request_id': 'req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:15.414905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0e2add97d14fe98880b55132c9f16f', 'request_id': 'req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:15.465584 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0e2add97d14fe98880b55132c9f16f', 'request_id': 'req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:15.476876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] The token cache is being invalidate because project cd0e2add97d14fe98880b55132c9f16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:15.477162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:15.477787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eda5ae27-9cc3-42c1-a5e8-fccf8c3cf58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:15.479335 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1221/2431] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:15 2022] DELETE /identity/v3/projects/cd0e2add97d14fe98880b55132c9f16f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:15.485006 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.485327 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.485608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.503968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:15.505190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:15.563941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1211/2432] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:15.571375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc741df-8f06-491e-b721-66b48520277f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.571685 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc741df-8f06-491e-b721-66b48520277f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.571963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc741df-8f06-491e-b721-66b48520277f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.589607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3bc741df-8f06-491e-b721-66b48520277f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:15.590718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3bc741df-8f06-491e-b721-66b48520277f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:15.598489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1222/2433] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:15.602446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.612378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a654e5-0561-4200-839b-fba0e3406da5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.616943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.617583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.617866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.618143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.618866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:15.619177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:15.620809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:15.632613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1212/2434] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:15.636557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc741df-8f06-491e-b721-66b48520277f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.645362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc741df-8f06-491e-b721-66b48520277f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.650250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.650889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.651170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.651446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.652168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:15.654059 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:15.729235 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1223/2435] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:15 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:15.733797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.743746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be6f35-6491-4cb4-9d8d-2751460be010 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.799206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.799893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.800179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.800455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.801133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:15.803056 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:15.899942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1213/2436] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:15 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:15.904445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.914549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5586418-87c6-4bb8-990c-acbb448cc103 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.921561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.921561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.921561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.921561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.922012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:15.923598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:15.933930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1224/2437] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:15.937814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.947819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42907-d3ed-4674-a4f5-90cfd62ec060 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.952691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5003594-07fd-44a8-b8ad-ddac1f58ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.953343 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5003594-07fd-44a8-b8ad-ddac1f58ca80 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.953625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5003594-07fd-44a8-b8ad-ddac1f58ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.953925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5003594-07fd-44a8-b8ad-ddac1f58ca80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:15.954631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5003594-07fd-44a8-b8ad-ddac1f58ca80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:15.956392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5003594-07fd-44a8-b8ad-ddac1f58ca80 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:15.966964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1214/2438] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:15.973340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:15.983872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964d6e-1658-4ee6-a5f6-ba5b1b3f90af admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:15.988262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:15.989133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:15.989410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:15.989727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] PATH_INFO: `/v3/projects/9a2a26ce2d1e4d848871d08267e5c1f3/users/ae4e75dbd6b94dc2ac673e2545d6d63c/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:16.004214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2a26ce2d1e4d848871d08267e5c1f3, user_id=ae4e75dbd6b94dc2ac673e2545d6d63c, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:16.006840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:16.100503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1225/2439] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:15 2022] PUT /identity/v3/projects/9a2a26ce2d1e4d848871d08267e5c1f3/users/ae4e75dbd6b94dc2ac673e2545d6d63c/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:16.113129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:16.113491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:16.113823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:16.139824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] MFA Rules not processed for user `ae4e75dbd6b94dc2ac673e2545d6d63c`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:16.141030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:16.204148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1215/2440] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:16.215323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:16.217658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:16.289966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011c0a6-efb2-4a96-8106-af04b1f45a6b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:16.295886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4ec60-95b6-416d-ae5b-be4c161cb779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:16.296516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4ec60-95b6-416d-ae5b-be4c161cb779 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:16.296799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4ec60-95b6-416d-ae5b-be4c161cb779 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:16.297089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4ec60-95b6-416d-ae5b-be4c161cb779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:16.304644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4ec60-95b6-416d-ae5b-be4c161cb779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:16.306209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4ec60-95b6-416d-ae5b-be4c161cb779 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:16.315072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1226/2441] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:19.367274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:19.428694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d958f93-f8e9-48dd-b23b-bd2849dc151e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:19.433076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:19.433940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:19.434219 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:19.434495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] PATH_INFO: `/v3/users/ae4e75dbd6b94dc2ac673e2545d6d63c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:19.435702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4e75dbd6b94dc2ac673e2545d6d63c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:19.437639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:19.604944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4e75dbd6b94dc2ac673e2545d6d63c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:19.677596 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4e75dbd6b94dc2ac673e2545d6d63c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:19.685493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4e75dbd6b94dc2ac673e2545d6d63c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:19.686734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4e75dbd6b94dc2ac673e2545d6d63c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:19.687418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4e75dbd6b94dc2ac673e2545d6d63c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:19.705363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1216/2442] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:19 2022] DELETE /identity/v3/users/ae4e75dbd6b94dc2ac673e2545d6d63c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:19.709762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:19.710232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:19.710328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:19.727588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:19.728806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:19.786658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1227/2443] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:19.796760 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:19.798347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:19.854481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb194c-b68c-4958-bc02-dccdb96dc90f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:19.858502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b1427-62d1-447b-ba89-14dea1a353a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:19.859149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b1427-62d1-447b-ba89-14dea1a353a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:19.859429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b1427-62d1-447b-ba89-14dea1a353a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:19.859739 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b1427-62d1-447b-ba89-14dea1a353a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:19.869081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b1427-62d1-447b-ba89-14dea1a353a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:19.870515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b1427-62d1-447b-ba89-14dea1a353a7 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:19.880815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1217/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:20.268448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.270041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:20.291772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be836b-f2f6-4048-838e-d456d5724c95 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.298152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:20.299391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.299807 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.300149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] PATH_INFO: `/v3/projects/9a2a26ce2d1e4d848871d08267e5c1f3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.301534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2a26ce2d1e4d848871d08267e5c1f3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:20.303549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:20.393951 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2a26ce2d1e4d848871d08267e5c1f3', 'request_id': 'req-953fb059-f0ae-4bcd-a28b-c228b0d4394f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:20.399688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2a26ce2d1e4d848871d08267e5c1f3', 'request_id': 'req-953fb059-f0ae-4bcd-a28b-c228b0d4394f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:20.443465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2a26ce2d1e4d848871d08267e5c1f3', 'request_id': 'req-953fb059-f0ae-4bcd-a28b-c228b0d4394f'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:20.454812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] The token cache is being invalidate because project 9a2a26ce2d1e4d848871d08267e5c1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:20.455097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:20.455749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-953fb059-f0ae-4bcd-a28b-c228b0d4394f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:20.457279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1228/2445] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:20 2022] DELETE /identity/v3/projects/9a2a26ce2d1e4d848871d08267e5c1f3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:20.462071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.462665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.462665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.480740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:20.481985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:20.556783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1218/2446] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:20.563469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.563799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.564071 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.582151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:20.583361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:20.591131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1229/2447] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:20.596093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.605689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a8ff8-3119-40a0-aefb-ed548dfbba38 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.612109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:20.612763 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.613048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.613329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.614057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:20.614363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:20.616020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:20.631336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1219/2448] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:20.634639 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.644077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979ca2d-eabd-4eff-a8c9-047a018afe9b None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.649033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:20.649909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.650103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.650381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.651079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:20.653004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:20.730811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1230/2449] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:20 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:20.735386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.745493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e47a-d713-47e7-a51f-d4439c387ea2 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.800046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:20.800726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.800997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.801280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.801949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:20.803871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:20.895822 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1220/2450] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:20 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:20.900061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.910814 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d188e9d-c5b6-4de1-aad0-3370d2611845 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.915429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:20.916394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.916844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.917279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.918000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:20.919581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:20.929954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1231/2451] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:20.934105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.944364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bed88e-ee81-478c-826b-70294480bdf5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.954506 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6718-0cbf-4851-8663-4a46cc222e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:20.955185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6718-0cbf-4851-8663-4a46cc222e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:20.955938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6718-0cbf-4851-8663-4a46cc222e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:20.956221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6718-0cbf-4851-8663-4a46cc222e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:20.958067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6718-0cbf-4851-8663-4a46cc222e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:20.959758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6718-0cbf-4851-8663-4a46cc222e47 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:20.976877 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1221/2452] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:20.984729 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:20.995229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985cff0-de6a-459c-ba9e-c047b3400621 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:20.999735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:21.000613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:21.000893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:21.001165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] PATH_INFO: `/v3/projects/4c0b2b1832de4efab91a083b95b47f11/users/5e5818f5d46d4a59a34b33c84c110ed9/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:21.017233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0b2b1832de4efab91a083b95b47f11, user_id=5e5818f5d46d4a59a34b33c84c110ed9, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:21.019893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:21.083857 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1232/2453] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:20 2022] PUT /identity/v3/projects/4c0b2b1832de4efab91a083b95b47f11/users/5e5818f5d46d4a59a34b33c84c110ed9/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:21.095400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:21.095513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:21.095820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:21.122485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] MFA Rules not processed for user `5e5818f5d46d4a59a34b33c84c110ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:21.124334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:21.188070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1222/2454] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:21.198820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:21.200523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:21.256791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ecca8-a788-41fa-8ba2-53083a42e7aa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:21.260297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c290683b-56a9-43fa-9304-3fef7d71d2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:21.260927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290683b-56a9-43fa-9304-3fef7d71d2ad service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:21.261201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290683b-56a9-43fa-9304-3fef7d71d2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:21.261475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290683b-56a9-43fa-9304-3fef7d71d2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:21.270088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290683b-56a9-43fa-9304-3fef7d71d2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:21.271496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c290683b-56a9-43fa-9304-3fef7d71d2ad service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:21.280139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1233/2455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:25.395693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:25.397164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:25.460566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aaeeb3-a7f4-4c05-9f9c-d182b3fa6aab None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:25.465000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:25.465860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:25.466141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:25.466417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] PATH_INFO: `/v3/users/42f68286e2014a7889940bbbedf622cd` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:25.467625 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f68286e2014a7889940bbbedf622cd)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:25.470139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:25.615232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f68286e2014a7889940bbbedf622cd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:25.693573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f68286e2014a7889940bbbedf622cd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:25.700517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f68286e2014a7889940bbbedf622cd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:25.701148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f68286e2014a7889940bbbedf622cd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:25.701740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f68286e2014a7889940bbbedf622cd'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:25.722106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1223/2456] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:25 2022] DELETE /identity/v3/users/42f68286e2014a7889940bbbedf622cd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:25.723890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:25.724383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:25.724556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:25.741371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:25.742566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:25.799020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1234/2457] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:25.808677 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:25.810059 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:25.865947 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807a4e8-5096-4a18-826e-b3cd51055e2d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:25.869487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f013c17-59c3-40b1-a9b8-511fa031604b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:25.870114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013c17-59c3-40b1-a9b8-511fa031604b service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:25.870391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013c17-59c3-40b1-a9b8-511fa031604b service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:25.870664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f013c17-59c3-40b1-a9b8-511fa031604b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:25.879864 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f013c17-59c3-40b1-a9b8-511fa031604b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:25.881281 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f013c17-59c3-40b1-a9b8-511fa031604b service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:25.891077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1224/2458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:26.257038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:26.258628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:26.281065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff68a22-40b8-4441-9b1e-5eb754bfcb5a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:26.288835 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:26.289697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.289982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.290258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] PATH_INFO: `/v3/projects/7c1d4a93256c4a1ca76d7781d1da0b30` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.291758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1d4a93256c4a1ca76d7781d1da0b30)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:26.293730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:26.414717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1d4a93256c4a1ca76d7781d1da0b30', 'request_id': 'req-9422230f-fac8-40ef-b34a-1df93597d3cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:26.420956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1d4a93256c4a1ca76d7781d1da0b30', 'request_id': 'req-9422230f-fac8-40ef-b34a-1df93597d3cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:26.477016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1d4a93256c4a1ca76d7781d1da0b30', 'request_id': 'req-9422230f-fac8-40ef-b34a-1df93597d3cd'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:26.489180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] The token cache is being invalidate because project 7c1d4a93256c4a1ca76d7781d1da0b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:26.489482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:26.490105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9422230f-fac8-40ef-b34a-1df93597d3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:26.491749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1235/2459] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:26 2022] DELETE /identity/v3/projects/7c1d4a93256c4a1ca76d7781d1da0b30 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:26.496645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.497142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.497345 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.514938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:26.516158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:26.575067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1225/2460] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:26.582852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.583061 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.583342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.601811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:26.603007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:26.611875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1236/2461] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:26.615975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:26.625737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba3324-da79-43a8-bc06-b4c34ac773a6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:26.630313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:26.630958 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.631241 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.631515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.632272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:26.632580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:26.634172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:26.647644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1226/2462] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:26.650217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:26.659957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434296bf-9992-400a-8789-f4bf0fca6ef6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:26.664681 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:26.665323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.665607 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.665885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.666833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:26.668778 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:26.755762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1237/2463] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:26 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:26.757068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:26.767577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cea9-2f69-41ed-b8d8-2204c1a8bddf admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:26.824791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:26.825661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.825971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.826248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.826950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:26.829500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:26.917938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1227/2464] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:26 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:26.921811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:26.932037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece619-f21d-4725-92ca-40da7a851c3c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:26.936640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:26.937329 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.937609 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.937883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.938626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:26.940246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:26.950714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1238/2465] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:26.955093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:26.965154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1e629-c1d8-431f-9cf9-722c6992420d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:26.970486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc4c36-d142-40e5-a4d3-3f27233669ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:26.971143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc4c36-d142-40e5-a4d3-3f27233669ec admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:26.971427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc4c36-d142-40e5-a4d3-3f27233669ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:26.971906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc4c36-d142-40e5-a4d3-3f27233669ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:26.972522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc4c36-d142-40e5-a4d3-3f27233669ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:26.974120 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc4c36-d142-40e5-a4d3-3f27233669ec admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:26.987960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1228/2466] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:26.995585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:27.009569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f6eb-634f-4642-a7c7-b7509cba3b9e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:27.014345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:27.015769 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:27.016049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:27.016343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] PATH_INFO: `/v3/projects/5eba7e3d75284ddd8d62aeb7c5b6bc43/users/8b6bc7de10344be8a9567722726a19f6/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:27.031285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eba7e3d75284ddd8d62aeb7c5b6bc43, user_id=8b6bc7de10344be8a9567722726a19f6, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:27.033957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:27.111267 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1239/2467] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:26 2022] PUT /identity/v3/projects/5eba7e3d75284ddd8d62aeb7c5b6bc43/users/8b6bc7de10344be8a9567722726a19f6/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:27.176347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca6bf-3e4a-4d8b-895a-f3cd1ec879f2 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:27.176347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca6bf-3e4a-4d8b-895a-f3cd1ec879f2 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:27.176347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ca6bf-3e4a-4d8b-895a-f3cd1ec879f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:27.207595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a64ca6bf-3e4a-4d8b-895a-f3cd1ec879f2 None None] MFA Rules not processed for user `8b6bc7de10344be8a9567722726a19f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:27.208875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a64ca6bf-3e4a-4d8b-895a-f3cd1ec879f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:27.274058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1229/2468] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:27.285117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:27.286931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:27.348393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7489-d4c8-4532-b27d-8bb897840b98 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:27.352037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:27.352739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:27.353020 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:27.353291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:27.362027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:27.363443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:27.372491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1240/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:29.106392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b00f-9518-4dd3-9b81-b3b2cabf28ff None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:29.106887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b00f-9518-4dd3-9b81-b3b2cabf28ff None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:29.107704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910b00f-9518-4dd3-9b81-b3b2cabf28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:29.124538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-9910b00f-9518-4dd3-9b81-b3b2cabf28ff None None] MFA Rules not processed for user `8b6bc7de10344be8a9567722726a19f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:29.125855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9910b00f-9518-4dd3-9b81-b3b2cabf28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:29.136662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1230/2470] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:30.880535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:30.881945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:30.946384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc60b2e-c3f1-4f6d-9ebf-f1e9b02cac61 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:30.950872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:30.951762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:30.952042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:30.952315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] PATH_INFO: `/v3/users/5e5818f5d46d4a59a34b33c84c110ed9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:30.954050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5818f5d46d4a59a34b33c84c110ed9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:30.955994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:31.098273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5818f5d46d4a59a34b33c84c110ed9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:31.203476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5818f5d46d4a59a34b33c84c110ed9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:31.210498 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5818f5d46d4a59a34b33c84c110ed9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:31.211122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5818f5d46d4a59a34b33c84c110ed9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:31.223156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5818f5d46d4a59a34b33c84c110ed9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:31.229271 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1241/2471] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:30 2022] DELETE /identity/v3/users/5e5818f5d46d4a59a34b33c84c110ed9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:31.234004 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:31.234491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:31.234614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:31.252655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:31.253828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:31.309670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1231/2472] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:31.319185 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:31.320626 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:31.376056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280343-4ad8-45f4-98f1-3a4e8a81afb9 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:31.379593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f494-858c-4d32-a0da-2f43fa2cc3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:31.380257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f494-858c-4d32-a0da-2f43fa2cc3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:31.380535 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f494-858c-4d32-a0da-2f43fa2cc3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:31.380808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f494-858c-4d32-a0da-2f43fa2cc3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:31.389622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27f494-858c-4d32-a0da-2f43fa2cc3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:31.391567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27f494-858c-4d32-a0da-2f43fa2cc3d8 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:31.401118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1242/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:56:31.922836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:31.924529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:31.937500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1116f5-ea36-49fc-a493-a39c3c769194 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:31.943026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:31.944225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:31.944505 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:31.944773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] PATH_INFO: `/v3/projects/4c0b2b1832de4efab91a083b95b47f11` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:31.945950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0b2b1832de4efab91a083b95b47f11)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:31.948058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.056015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0b2b1832de4efab91a083b95b47f11', 'request_id': 'req-badb94a5-4400-43ee-b259-d5b3c56483df'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:32.061613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0b2b1832de4efab91a083b95b47f11', 'request_id': 'req-badb94a5-4400-43ee-b259-d5b3c56483df'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:32.140164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0b2b1832de4efab91a083b95b47f11', 'request_id': 'req-badb94a5-4400-43ee-b259-d5b3c56483df'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:32.152529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] The token cache is being invalidate because project 4c0b2b1832de4efab91a083b95b47f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:32.152816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:32.153468 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-badb94a5-4400-43ee-b259-d5b3c56483df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:32.155195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1232/2474] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:31 2022] DELETE /identity/v3/projects/4c0b2b1832de4efab91a083b95b47f11 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:32.160106 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.160613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.160706 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.179207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:32.180433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:32.245516 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1243/2475] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:32.255251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.256034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.256034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.274388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:32.275817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:32.284252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1233/2476] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:32.288519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.299409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53958e79-8b36-4b43-b81b-0d52452c1375 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.304096 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.304762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.305050 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.305371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.312869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:32.312869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:32.312869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.320865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1244/2477] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:32.324626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.333814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb140-1325-41a4-accd-77a7d56f4b94 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.338450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.339086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.339364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.339668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.340357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:32.342236 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.441644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1234/2478] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:32 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:32.443107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.454851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5e277-05de-435c-95a4-e16275a44a87 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.510695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.511487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.511798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.512077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.516111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:32.516111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.606012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1245/2479] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:32 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:32.607277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.618041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4776d-79d3-4468-bc29-1722a5d57654 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.622704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.623369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.623670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.623946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.624766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:32.626354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.636746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1235/2480] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:32.640844 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.651042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ef88d-3343-44ae-845c-8b9f2c446a82 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.655795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd50a9-7abe-40b3-9503-a6ed7053ca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.657184 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd50a9-7abe-40b3-9503-a6ed7053ca50 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.657469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd50a9-7abe-40b3-9503-a6ed7053ca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.657753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd50a9-7abe-40b3-9503-a6ed7053ca50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.658487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd50a9-7abe-40b3-9503-a6ed7053ca50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:32.660115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd50a9-7abe-40b3-9503-a6ed7053ca50 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.670293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1246/2481] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:32.675283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.685326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f204b2b-698e-457a-b5ee-e5d008f6871b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.689984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.690860 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.691144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.691450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] PATH_INFO: `/v3/projects/1ee28aa96c2e4b0db23133ff906d8850/users/b8172c47c4394bf59c208c5dff94a077/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.706797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee28aa96c2e4b0db23133ff906d8850, user_id=b8172c47c4394bf59c208c5dff94a077, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:32.709469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:32.793443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1236/2482] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:32 2022] PUT /identity/v3/projects/1ee28aa96c2e4b0db23133ff906d8850/users/b8172c47c4394bf59c208c5dff94a077/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:32.805650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:32.805947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:32.806218 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:32.835146 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] MFA Rules not processed for user `b8172c47c4394bf59c208c5dff94a077`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:32.836414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:32.903370 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1247/2483] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:32.908046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:32.993541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c46ca9-38c5-46c0-a504-5eb0a5eb96a9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:32.998716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:32.999387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.000359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.000704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.002573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.003417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.094331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1237/2484] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:32 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:33.105428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.117033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e609b6a-5595-4c6b-a53f-016c9766a3a4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.174316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.175079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.175301 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.175570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.176288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.178203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.243371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1248/2485] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:33 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:33.246957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.257259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc23a9-c80f-47a0-ae11-a1ef11fad009 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.261896 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.262668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.262955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.263232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.264083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.265810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.276613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1238/2486] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:33.280810 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.291081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b161-5833-45b5-a900-01733e983a8e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.296318 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.297868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.298241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.298610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] PATH_INFO: `/v3/projects/53b1798dbcfa423dbe7cdef6ae3da6c9/users/31712795cf1643f29b95dde6627c453e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.314091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b1798dbcfa423dbe7cdef6ae3da6c9, user_id=31712795cf1643f29b95dde6627c453e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.316888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.414641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1249/2487] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:33 2022] PUT /identity/v3/projects/53b1798dbcfa423dbe7cdef6ae3da6c9/users/31712795cf1643f29b95dde6627c453e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:33.418918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.429963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b227b4c-2869-4780-9971-503ac56f74ca admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.490784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f305-01ff-4cc6-b3b9-069adbd48450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.491490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f305-01ff-4cc6-b3b9-069adbd48450 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.491807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f305-01ff-4cc6-b3b9-069adbd48450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.492089 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f305-01ff-4cc6-b3b9-069adbd48450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.492833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f305-01ff-4cc6-b3b9-069adbd48450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.494523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f305-01ff-4cc6-b3b9-069adbd48450 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.505921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1239/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:33.509725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.521559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c66ea-da66-444d-b2b4-b4a6e234a2d5 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.529427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.530446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.530827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.531253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] PATH_INFO: `/v3/projects/53b1798dbcfa423dbe7cdef6ae3da6c9/users/31712795cf1643f29b95dde6627c453e/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.533405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b1798dbcfa423dbe7cdef6ae3da6c9, user_id=31712795cf1643f29b95dde6627c453e, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.540744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.557361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1250/2489] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:33 2022] PUT /identity/v3/projects/53b1798dbcfa423dbe7cdef6ae3da6c9/users/31712795cf1643f29b95dde6627c453e/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:33.567893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.568203 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.568483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.597147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] MFA Rules not processed for user `31712795cf1643f29b95dde6627c453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:33.598450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:33.670584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1240/2490] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:33.681854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.683512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:33.741079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de491-edd3-4d6e-8e19-c2d15780b0c1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.745569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.746408 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.746697 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.746971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:33.757870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:33.758854 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:33.771078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1251/2491] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:33.971408 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:33.981690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f8d23-fec6-4239-8b6a-7e118b5c633f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:33.985809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a3615-6130-4d68-8a4b-b2e47e2f84e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:33.986900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3615-6130-4d68-8a4b-b2e47e2f84e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:33.986900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3615-6130-4d68-8a4b-b2e47e2f84e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:33.987083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3615-6130-4d68-8a4b-b2e47e2f84e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:34.044804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a3615-6130-4d68-8a4b-b2e47e2f84e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:34.046165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a3615-6130-4d68-8a4b-b2e47e2f84e7 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:34.055255 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1241/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:45.522619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:45.594728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adce186-d0a3-4b06-a76c-9d6461d3fe69 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:45.599725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:45.600600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:45.600909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:45.601158 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] PATH_INFO: `/v3/users/b8172c47c4394bf59c208c5dff94a077` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:45.602442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8172c47c4394bf59c208c5dff94a077)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:45.604633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:45.794539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8172c47c4394bf59c208c5dff94a077'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:45.883906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8172c47c4394bf59c208c5dff94a077'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:45.903984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8172c47c4394bf59c208c5dff94a077'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:45.907476 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8172c47c4394bf59c208c5dff94a077'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:45.951139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8172c47c4394bf59c208c5dff94a077'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:45.978278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1252/2493] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:45 2022] DELETE /identity/v3/users/b8172c47c4394bf59c208c5dff94a077 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:45.979801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:45.980670 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:45.981122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:46.047473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:46.049386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:46.192498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1242/2494] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:46.220911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:46.222416 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:46.299155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767cbc9-8993-4584-8eb5-db067a3b6bd5 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:46.303042 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:46.303875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:46.304300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:46.304660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:46.327749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:46.329230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:46.358395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1253/2495] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:46.936607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:46.938033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:46.955227 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5529-2d72-4ac1-8c67-be02e3fd9989 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:46.961918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:46.962646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:46.962930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:46.963206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] PATH_INFO: `/v3/projects/1ee28aa96c2e4b0db23133ff906d8850` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:46.965656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee28aa96c2e4b0db23133ff906d8850)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:46.966425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:47.093868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee28aa96c2e4b0db23133ff906d8850', 'request_id': 'req-b1bcc132-aef8-464b-b1fe-ac36f0110438'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.100273 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee28aa96c2e4b0db23133ff906d8850', 'request_id': 'req-b1bcc132-aef8-464b-b1fe-ac36f0110438'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.197261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee28aa96c2e4b0db23133ff906d8850', 'request_id': 'req-b1bcc132-aef8-464b-b1fe-ac36f0110438'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.214150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] The token cache is being invalidate because project 1ee28aa96c2e4b0db23133ff906d8850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:47.214447 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.215116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.218533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1243/2496] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:46 2022] DELETE /identity/v3/projects/1ee28aa96c2e4b0db23133ff906d8850 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:47.222676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:47.233431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353a511-cc8d-4c53-a335-c98187d92f84 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:47.296443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:47.297333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:47.297613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:47.297913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] PATH_INFO: `/v3/users/31712795cf1643f29b95dde6627c453e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:47.299738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31712795cf1643f29b95dde6627c453e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:47.301660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:47.517873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31712795cf1643f29b95dde6627c453e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.597504 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31712795cf1643f29b95dde6627c453e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.604748 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31712795cf1643f29b95dde6627c453e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.605391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31712795cf1643f29b95dde6627c453e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.617831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b02cd27f-3b6a-48f4-a3c5-50b061270290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31712795cf1643f29b95dde6627c453e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:47.624037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1254/2497] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:47 2022] DELETE /identity/v3/users/31712795cf1643f29b95dde6627c453e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:48.029997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.031405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:48.044707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcc132-aef8-464b-b1fe-ac36f0110438 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.107944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.108808 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.109084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.109405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] PATH_INFO: `/v3/projects/53b1798dbcfa423dbe7cdef6ae3da6c9` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.110600 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b1798dbcfa423dbe7cdef6ae3da6c9)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.112568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:48.231361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b1798dbcfa423dbe7cdef6ae3da6c9', 'request_id': 'req-39bb7972-b479-440f-ab2c-c78068f32af0'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:48.236692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b1798dbcfa423dbe7cdef6ae3da6c9', 'request_id': 'req-39bb7972-b479-440f-ab2c-c78068f32af0'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:48.300879 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b1798dbcfa423dbe7cdef6ae3da6c9', 'request_id': 'req-39bb7972-b479-440f-ab2c-c78068f32af0'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:48.316390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] The token cache is being invalidate because project 53b1798dbcfa423dbe7cdef6ae3da6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:48.316929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:48.317741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-39bb7972-b479-440f-ab2c-c78068f32af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:48.321069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1244/2498] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:48 2022] DELETE /identity/v3/projects/53b1798dbcfa423dbe7cdef6ae3da6c9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:48.326005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.326478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.326574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.359315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:48.361395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:48.425750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1255/2499] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:48.434019 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.434426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.434815 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.456336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:48.457579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:48.465979 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1245/2500] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:48.470275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.479888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e645a1-f6d9-4596-a3d2-9acf13510e64 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.484571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.485209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.485490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.485766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.487129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:48.487411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.489056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:48.500616 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1256/2501] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:48.505379 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.514486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136302ff-44bf-4991-84f5-b0addc126fce None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.519289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.519985 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.520268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.520547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.521230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.523130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:48.645168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1246/2502] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:48 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:48.650289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.664140 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f892e-7c6b-451c-b904-a2415fd78502 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.734986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.735727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.736556 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.736836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.737545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.739483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:48.829453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1257/2503] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:48 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:48.830748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.841664 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07723954-8245-4786-bbf2-974b4657b8c7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.847685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.848459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.852102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.852102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.852102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.852102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:48.866323 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1247/2504] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:56:48.867782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.878279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c756-d2ee-409d-be60-68393d8a9f07 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.883488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca4239-f43f-4c9b-8cb7-6dd1abb1d202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.884250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca4239-f43f-4c9b-8cb7-6dd1abb1d202 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.884608 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca4239-f43f-4c9b-8cb7-6dd1abb1d202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.884952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca4239-f43f-4c9b-8cb7-6dd1abb1d202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.885791 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca4239-f43f-4c9b-8cb7-6dd1abb1d202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.887529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca4239-f43f-4c9b-8cb7-6dd1abb1d202 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:48.900104 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1258/2505] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:56:48.904684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:48.915252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3c828-b50f-4668-a525-369dfae53896 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:48.920348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:48.921232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:48.921563 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:48.921845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] PATH_INFO: `/v3/projects/ff9700bc92c1478d90c731fff819d8d2/users/c43486e6fe8f4c18b0558814c4a2c7e8/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:48.936685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9700bc92c1478d90c731fff819d8d2, user_id=c43486e6fe8f4c18b0558814c4a2c7e8, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:48.939360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.046779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1248/2506] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:48 2022] PUT /identity/v3/projects/ff9700bc92c1478d90c731fff819d8d2/users/c43486e6fe8f4c18b0558814c4a2c7e8/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:49.050111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.050447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.050724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.101641 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] MFA Rules not processed for user `c43486e6fe8f4c18b0558814c4a2c7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:49.103054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:49.177293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1259/2507] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:49.181953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:49.246432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2757b-5046-438e-914b-f5ab1381a7f4 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:49.251222 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:49.252494 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.252770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.253038 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.253727 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:49.255647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.404913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1249/2508] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:49 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:49.408569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:49.420027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e9bcf-55ca-4a1b-9a65-32393397d3d6 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:49.477612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:49.478265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.478545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.478818 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.479507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:49.481448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.592732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1260/2509] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:49 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:49.598385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:49.613134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7ada8-6eb0-4737-ab41-2e98004d9b5f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:49.619436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:49.621298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.621745 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.622215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.623138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:49.625865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.647709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1250/2510] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:56:49.654971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:49.671909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35799a62-4fa4-40ab-9e78-71e680fdd025 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:49.679593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:49.681099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.681483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.681885 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] PATH_INFO: `/v3/projects/8b18a17a75284f4298bbcd8cc08fd620/users/98a47672dc4f47a68db0e4cc5dd5a9c4/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.702314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b18a17a75284f4298bbcd8cc08fd620, user_id=98a47672dc4f47a68db0e4cc5dd5a9c4, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:49.704196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.778571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1261/2511] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:49 2022] PUT /identity/v3/projects/8b18a17a75284f4298bbcd8cc08fd620/users/98a47672dc4f47a68db0e4cc5dd5a9c4/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:49.783272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:49.794838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b48f9-010c-4495-be38-a8df44026a02 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:49.853749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078b509-ed87-4383-9738-32d155fff1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:49.854501 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b509-ed87-4383-9738-32d155fff1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.854788 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b509-ed87-4383-9738-32d155fff1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.855064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078b509-ed87-4383-9738-32d155fff1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.855828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b509-ed87-4383-9738-32d155fff1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:49.857444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078b509-ed87-4383-9738-32d155fff1ed admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.868714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1251/2512] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:56:49.872598 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:49.883262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c99c43-ac96-4047-af13-744e79359ef8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:49.888266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:49.889153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.889435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.889723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] PATH_INFO: `/v3/projects/8b18a17a75284f4298bbcd8cc08fd620/users/98a47672dc4f47a68db0e4cc5dd5a9c4/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.893063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b18a17a75284f4298bbcd8cc08fd620, user_id=98a47672dc4f47a68db0e4cc5dd5a9c4, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:49.897339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:49.918845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1262/2513] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:49 2022] PUT /identity/v3/projects/8b18a17a75284f4298bbcd8cc08fd620/users/98a47672dc4f47a68db0e4cc5dd5a9c4/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:49.928470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:49.928842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:49.929128 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:49.955900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] MFA Rules not processed for user `98a47672dc4f47a68db0e4cc5dd5a9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:49.957231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:50.025397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1252/2514] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:50.038688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:50.040430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:50.111690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7917bf-c598-414c-bcc4-49de4c4fe61d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:50.115444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed75cde-ed94-478a-a36f-147e6fc09865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:50.116225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed75cde-ed94-478a-a36f-147e6fc09865 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:50.116759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed75cde-ed94-478a-a36f-147e6fc09865 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:50.116924 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed75cde-ed94-478a-a36f-147e6fc09865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:50.126169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed75cde-ed94-478a-a36f-147e6fc09865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:50.127762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed75cde-ed94-478a-a36f-147e6fc09865 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:50.137186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1263/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:50.253209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:50.263830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae8103-6264-4973-8465-4726a8f206b4 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:50.267883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:50.268531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:50.268814 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:50.269094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:50.329672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:50.331146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:50.340818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1253/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:50.545753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ace4a-93d0-4e87-9c5f-463d3179bf8f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:50.546283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ace4a-93d0-4e87-9c5f-463d3179bf8f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:50.546283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ace4a-93d0-4e87-9c5f-463d3179bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:50.567322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-696ace4a-93d0-4e87-9c5f-463d3179bf8f None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:50.568692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-696ace4a-93d0-4e87-9c5f-463d3179bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:50.626632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1264/2517] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:56:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:50.648482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:50.650080 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:50.723889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda7799-db05-48bd-a511-4fe95e9ede43 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:50.728854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:50.729489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:50.729767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:50.730040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:50.739223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:50.749250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:50.749250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1254/2518] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:56:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:56:51.761496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:51.761496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:51.761496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:51.774645 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:51.775909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:51.783460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1265/2519] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 22:56:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:51.797081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:51.807434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fce902-c9c1-4269-b809-d92e4fa3c372 service swift] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:51.812477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e408-fe43-4bdf-8e1b-8e5a9eefe03c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:51.813048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e408-fe43-4bdf-8e1b-8e5a9eefe03c service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:51.813330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e408-fe43-4bdf-8e1b-8e5a9eefe03c service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:51.813604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e408-fe43-4bdf-8e1b-8e5a9eefe03c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:51.821435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e408-fe43-4bdf-8e1b-8e5a9eefe03c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:51.823000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e408-fe43-4bdf-8e1b-8e5a9eefe03c service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:51.830867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1255/2520] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:56:52.490912 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:52.492328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:52.545715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:52.546073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:52.546420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:52.549183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496f059-8677-433d-9bc8-58dacbbed955 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:52.553107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:52.553827 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:52.554109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:52.554457 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:52.556381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:52.564624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:52.565799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:52.572909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1256/2521] 10.222.0.23 () {58 vars in 1009 bytes} [Tue May 3 22:56:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:52.585470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:52.607063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e871bd-a5d6-4a73-bea7-4e4a071ac224 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:52.607063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcaf18-31be-4d5b-b032-4371de0816ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:52.607063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaf18-31be-4d5b-b032-4371de0816ee service swift] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:52.607063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaf18-31be-4d5b-b032-4371de0816ee service swift] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:52.607535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaf18-31be-4d5b-b032-4371de0816ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:52.613723 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaf18-31be-4d5b-b032-4371de0816ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:52.615431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaf18-31be-4d5b-b032-4371de0816ee service swift] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:52.623633 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:52.623980 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1257/2522] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:56:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:56:52.625285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:52.635226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1266/2523] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:53.311196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:53.311717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:53.311832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:53.331905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] MFA Rules not processed for user `b8fef1a759164dfcbbf73546063fee79`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:53.333099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:53.343320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1258/2524] 10.222.0.23 () {58 vars in 967 bytes} [Tue May 3 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:53.358062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:53.370652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6742f9e-d129-4dc3-9f5d-e975e8a71233 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:53.376001 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596503b-09fc-4951-b664-a6684c57c52d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7b72281fc3f423094ed8df450d84db7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:53.376782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596503b-09fc-4951-b664-a6684c57c52d service swift] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:53.377133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596503b-09fc-4951-b664-a6684c57c52d service swift] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:53.377490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596503b-09fc-4951-b664-a6684c57c52d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:53.386247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596503b-09fc-4951-b664-a6684c57c52d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:53.387957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596503b-09fc-4951-b664-a6684c57c52d service swift] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:53.397295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1267/2525] 10.222.0.23 () {60 vars in 1384 bytes} [Tue May 3 22:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 03 22:56:53.424895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:53.436457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdbb429-8377-4656-857f-b17325a00e69 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:53.441061 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:53.441855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:53.442130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:53.442398 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] PATH_INFO: `/v3/users/c43486e6fe8f4c18b0558814c4a2c7e8` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:53.443580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43486e6fe8f4c18b0558814c4a2c7e8)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:53.445767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:53.705475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43486e6fe8f4c18b0558814c4a2c7e8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:53.819977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43486e6fe8f4c18b0558814c4a2c7e8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:53.828409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43486e6fe8f4c18b0558814c4a2c7e8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:53.829212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43486e6fe8f4c18b0558814c4a2c7e8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:53.829794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43486e6fe8f4c18b0558814c4a2c7e8'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:53.850099 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1259/2526] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:53 2022] DELETE /identity/v3/users/c43486e6fe8f4c18b0558814c4a2c7e8 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:53.854528 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:53.854823 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:53.855822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:53.879456 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:53.880730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:53.958954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1268/2527] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:53.966478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:53.968260 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:54.072422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be72660-244c-4c58-aa35-4626fc853647 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:54.072422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:54.072422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:54.072422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:54.072732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:54.086000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:54.087693 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:54.099569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1260/2528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:54.575953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:54.577431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:54.598350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aebf77-2bb0-427f-a539-cb39bb0e4be2 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:54.603572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:54.604804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:54.605144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:54.605580 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] PATH_INFO: `/v3/projects/ff9700bc92c1478d90c731fff819d8d2` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:54.606893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9700bc92c1478d90c731fff819d8d2)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:54.609100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:54.745531 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9700bc92c1478d90c731fff819d8d2', 'request_id': 'req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:54.755003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9700bc92c1478d90c731fff819d8d2', 'request_id': 'req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:54.850805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:54.860103 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9700bc92c1478d90c731fff819d8d2', 'request_id': 'req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:54.864303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e128e-32f7-45c3-91d3-5362e0a09041 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:54.873006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] The token cache is being invalidate because project ff9700bc92c1478d90c731fff819d8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:54.873287 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:54.873969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:54.879480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1269/2529] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:54 2022] DELETE /identity/v3/projects/ff9700bc92c1478d90c731fff819d8d2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:54.880411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:54.881922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:54.981817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:54.982472 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:54.982753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:54.983023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:54.985064 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:55.009161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5785c7-47a3-41a1-a5a8-12742e9bbe28 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:55.014770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:55.015703 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:55.015993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:55.016288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] PATH_INFO: `/v3/users/98a47672dc4f47a68db0e4cc5dd5a9c4` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:55.018766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a47672dc4f47a68db0e4cc5dd5a9c4)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:55.020979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:55.091420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:55.093173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:55.107300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1261/2530] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:56:55.311658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a47672dc4f47a68db0e4cc5dd5a9c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:55.408793 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a47672dc4f47a68db0e4cc5dd5a9c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:55.420567 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a47672dc4f47a68db0e4cc5dd5a9c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:55.421593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a47672dc4f47a68db0e4cc5dd5a9c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:55.476795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-2321984a-4951-4e8b-92a5-72da880166fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a47672dc4f47a68db0e4cc5dd5a9c4'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:55.498974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1270/2531] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:54 2022] DELETE /identity/v3/users/98a47672dc4f47a68db0e4cc5dd5a9c4 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:56.148035 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:56.159104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05625e-7400-4358-a9e2-768e4865c959 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:56.230414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:56.231357 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.231661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.231987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] PATH_INFO: `/v3/projects/8b18a17a75284f4298bbcd8cc08fd620` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.233221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b18a17a75284f4298bbcd8cc08fd620)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:56.235131 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:56.363308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b18a17a75284f4298bbcd8cc08fd620', 'request_id': 'req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.368581 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b18a17a75284f4298bbcd8cc08fd620', 'request_id': 'req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.431634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b18a17a75284f4298bbcd8cc08fd620', 'request_id': 'req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.445176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] The token cache is being invalidate because project 8b18a17a75284f4298bbcd8cc08fd620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:56.445474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.449231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.452375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1262/2532] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:56 2022] DELETE /identity/v3/projects/8b18a17a75284f4298bbcd8cc08fd620 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:56.457051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26fa07-62e3-4bd3-84fd-8acc77607042 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.457514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26fa07-62e3-4bd3-84fd-8acc77607042 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.457615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26fa07-62e3-4bd3-84fd-8acc77607042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.491109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3d26fa07-62e3-4bd3-84fd-8acc77607042 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:56.494577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3d26fa07-62e3-4bd3-84fd-8acc77607042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:56.522153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:56.524987 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:56.648528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7f30-3b5b-4ad6-8c1b-8b7d96c34816 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:56.649658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1271/2533] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:56.658411 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.659007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.659455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.660426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:56.661524 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.661988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.662423 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] PATH_INFO: `/v3/users/8b6bc7de10344be8a9567722726a19f6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.664298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6bc7de10344be8a9567722726a19f6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:56.667072 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:56.704084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:56.705886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:56.718715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1272/2534] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:56:56.723088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:56.734493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b531802-7c45-4779-aef6-5808884ad041 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:56.742708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:56.743694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.744135 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.744570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.745518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:56.746239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:56.748294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:56.790881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1273/2535] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:56:56.795300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:56.815288 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9525d-3e83-4eb4-a43c-e136c0d37e4e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:56.827717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:56.828388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.829367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.829367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.829749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:56.831572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:56.840117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6bc7de10344be8a9567722726a19f6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.906102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6bc7de10344be8a9567722726a19f6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.914876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6bc7de10344be8a9567722726a19f6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.915508 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6bc7de10344be8a9567722726a19f6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.916199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-221ece08-c0b9-4e7e-9c9f-38f89db28364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6bc7de10344be8a9567722726a19f6'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:56.934378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1263/2536] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:56 2022] DELETE /identity/v3/users/8b6bc7de10344be8a9567722726a19f6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:56.938811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:56.939684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:56.944311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:56.944405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1274/2537] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:56 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:56.948623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:56.953209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:56.960377 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:56.961586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:57.029039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1264/2538] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:57.037145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:57.040623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:57.090726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19c30a-1746-4b33-a4c2-c42b0ee9fa1e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.096444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.097122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.097402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.097675 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.098368 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.100642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.133392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67072ef0-9deb-4c45-8bc6-762e9126d158 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.133392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.133392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.133392 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.133975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.147998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.150483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.162013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1265/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:57.218952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1275/2540] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:56 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:57.220321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:57.235635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e53aeb-01f3-4640-b4dd-6fe75a294bb4 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.248962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.249809 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.250168 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.250518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.251878 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.254890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.273207 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1266/2541] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:57.277249 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:57.297455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717848d1-ff16-4a39-97d1-d201efb7e20f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.306525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.308346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.309462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.310168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.311794 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.316720 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.332195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1276/2542] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:57.336602 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:57.354675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b110dd-3a1e-466b-b2b6-32a54c6885e6 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.361990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.363011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.363366 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.363803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] PATH_INFO: `/v3/projects/1aae542610d64ee18f130c9c2d964113/users/4a98d72b92354c0d9d783ab19af70440/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.393909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aae542610d64ee18f130c9c2d964113, user_id=4a98d72b92354c0d9d783ab19af70440, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.397586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.492111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:57.495724 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:57.512499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150dcb2-dc8b-4d5d-b485-162c9e89b332 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.518480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.520513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.520880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.521305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] PATH_INFO: `/v3/users/d7353d5eef814367844ffbb574c6a45e` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.523537 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7353d5eef814367844ffbb574c6a45e)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.526047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.553534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1267/2543] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:57 2022] PUT /identity/v3/projects/1aae542610d64ee18f130c9c2d964113/users/4a98d72b92354c0d9d783ab19af70440/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:57.554499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:57.556187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:57.644154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370d79b-cc42-4566-868c-7dc48a6ab630 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:57.649076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:57.649954 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.650231 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.650499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] PATH_INFO: `/v3/projects/5eba7e3d75284ddd8d62aeb7c5b6bc43` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.651756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eba7e3d75284ddd8d62aeb7c5b6bc43)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:57.654012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:57.745819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7353d5eef814367844ffbb574c6a45e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.778450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eba7e3d75284ddd8d62aeb7c5b6bc43', 'request_id': 'req-db4c97ba-b9f5-43fa-938d-898500a32440'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.786133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eba7e3d75284ddd8d62aeb7c5b6bc43', 'request_id': 'req-db4c97ba-b9f5-43fa-938d-898500a32440'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.814717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7353d5eef814367844ffbb574c6a45e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.824559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7353d5eef814367844ffbb574c6a45e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.825078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7353d5eef814367844ffbb574c6a45e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.837977 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-95ca3b62-3ccd-442b-b6cc-332ac132becb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7353d5eef814367844ffbb574c6a45e'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.844444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1277/2544] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:57 2022] DELETE /identity/v3/users/d7353d5eef814367844ffbb574c6a45e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:57.846548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c67d5-e675-4527-b707-b006498a88ad None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:57.847058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c67d5-e675-4527-b707-b006498a88ad None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:57.847548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c67d5-e675-4527-b707-b006498a88ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:57.894806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-318c67d5-e675-4527-b707-b006498a88ad None None] MFA Rules not processed for user `4a98d72b92354c0d9d783ab19af70440`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:57.896985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-318c67d5-e675-4527-b707-b006498a88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:57.905784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eba7e3d75284ddd8d62aeb7c5b6bc43', 'request_id': 'req-db4c97ba-b9f5-43fa-938d-898500a32440'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.927130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] The token cache is being invalidate because project 5eba7e3d75284ddd8d62aeb7c5b6bc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:57.927434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.928353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:57.930825 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1268/2545] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:57 2022] DELETE /identity/v3/projects/5eba7e3d75284ddd8d62aeb7c5b6bc43 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:58.024033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1278/2546] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:58.036853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:58.038660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:58.106311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c97ba-b9f5-43fa-938d-898500a32440 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:58.299653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d654b-c818-4839-bd63-685c92d89c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:58.299653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d654b-c818-4839-bd63-685c92d89c0d service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:58.299653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d654b-c818-4839-bd63-685c92d89c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:58.299653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d654b-c818-4839-bd63-685c92d89c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:58.304801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d654b-c818-4839-bd63-685c92d89c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:58.304801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d654b-c818-4839-bd63-685c92d89c0d service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:58.304801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1269/2547] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:56:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:56:58.309198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c67d5-e675-4527-b707-b006498a88ad None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:58.311166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-318c67d5-e675-4527-b707-b006498a88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:58.404751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c67d5-e675-4527-b707-b006498a88ad None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:58.409642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:58.410501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:58.410783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:58.411056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] PATH_INFO: `/v3/projects/76dfa0aca06245aea5d79f4a92e36e17` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:58.440615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dfa0aca06245aea5d79f4a92e36e17)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:58.440615 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:58.574265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dfa0aca06245aea5d79f4a92e36e17', 'request_id': 'req-b245ff8f-4ee0-44ab-9682-6a0193741309'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:58.580873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dfa0aca06245aea5d79f4a92e36e17', 'request_id': 'req-b245ff8f-4ee0-44ab-9682-6a0193741309'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:58.665853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dfa0aca06245aea5d79f4a92e36e17', 'request_id': 'req-b245ff8f-4ee0-44ab-9682-6a0193741309'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:58.678746 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] The token cache is being invalidate because project 76dfa0aca06245aea5d79f4a92e36e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:56:58.679074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:58.679750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b245ff8f-4ee0-44ab-9682-6a0193741309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:56:58.685426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1279/2548] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:56:58 2022] DELETE /identity/v3/projects/76dfa0aca06245aea5d79f4a92e36e17 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:56:58.686487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:58.686774 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:58.687057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:58.706317 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:58.707971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:58.771652 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1270/2549] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:58.781649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:58.781649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:58.781649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:58.808391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:58.809604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:58.824826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1280/2550] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:58.829185 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:58.839267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba254d34-f791-46aa-9f21-ee898dcc58ec None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:58.844305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:58.847304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:58.847304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:58.847304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:58.847304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:56:58.847304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:58.848899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:58.866410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:58.872267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1271/2551] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:56:58.876544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fcc5f-aa1f-4152-997d-9ee21082c764 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:58.881512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:58.882261 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:58.882543 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:58.882816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:58.883510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:58.885509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.007521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1281/2552] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:58 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:56:59.010274 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.019441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bb34e-f07a-474a-b6df-d0448b4cab25 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.098823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.098823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.098823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.098823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.099339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.099339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.203283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1272/2553] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:59 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:59.208003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.217851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6141c5-ea87-4330-a62d-6309cb1e1efb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.223548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.224269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.224548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.224822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.225549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.227142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.241781 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1282/2554] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:56:59.245001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.256607 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37d204-f714-4da5-b909-ed5dc652067f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.262063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a9aa-803f-4694-9b0f-fcebad85df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.263181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a9aa-803f-4694-9b0f-fcebad85df55 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.263663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a9aa-803f-4694-9b0f-fcebad85df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.264112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a9aa-803f-4694-9b0f-fcebad85df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.265000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87a9aa-803f-4694-9b0f-fcebad85df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.267067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87a9aa-803f-4694-9b0f-fcebad85df55 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.289924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1273/2555] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:56:59.290926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.306798 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b31f6-f437-4af4-b0c0-9125b3d507e9 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.311472 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.313922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.314465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.314832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] PATH_INFO: `/v3/projects/343fca68bf0941babf525ccc76b25ba5/users/dde7a58466cc409c8225e6462e9287b7/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.330179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=343fca68bf0941babf525ccc76b25ba5, user_id=dde7a58466cc409c8225e6462e9287b7, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.333921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.478180 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1283/2556] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:56:59 2022] PUT /identity/v3/projects/343fca68bf0941babf525ccc76b25ba5/users/dde7a58466cc409c8225e6462e9287b7/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:56:59.488930 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.489406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.489522 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.515353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] MFA Rules not processed for user `dde7a58466cc409c8225e6462e9287b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:56:59.520758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:59.585143 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1274/2557] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:56:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:56:59.586771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.586907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.588515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:56:59.655778 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de2566-b5a0-4580-98c3-df584ef133ed None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.656177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c732e-1823-4b2b-8709-f896e7aacfaa admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.660907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.661447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.661770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.662052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.662163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.662332 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] PATH_INFO: `/v3/users/b9282b0e5cbb458bb31d462a76832aa9` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.662442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.662628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.663347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.663520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9282b0e5cbb458bb31d462a76832aa9)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.665453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.665628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.832902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1284/2558] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:56:59 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:56:59.836726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:56:59.895842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976602d-9ad3-4e32-a967-ec0c5521d328 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:56:59.900581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:56:59.902948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:56:59.902948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:56:59.902948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:56:59.902948 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:56:59.904723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:56:59.915144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9282b0e5cbb458bb31d462a76832aa9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.014486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1285/2559] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:56:59 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:00.018117 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.027477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490a53f-3b30-471f-a189-8ae538cd145d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.032122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.033246 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.033527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.033802 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.034514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.036116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.043147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9282b0e5cbb458bb31d462a76832aa9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.045893 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1286/2560] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:00.050384 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.051119 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9282b0e5cbb458bb31d462a76832aa9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.051839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9282b0e5cbb458bb31d462a76832aa9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.052502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9282b0e5cbb458bb31d462a76832aa9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.060099 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca98237-a72a-4126-a31a-298251497184 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.064687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.065521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.065801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.066076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] PATH_INFO: `/v3/projects/0b93ab1d6abc4b25916f6004a5e2b0af/users/1709b960bc2c4629bfabfbef9ff4b4d1/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.069252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1275/2561] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:56:59 2022] DELETE /identity/v3/users/b9282b0e5cbb458bb31d462a76832aa9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:00.081170 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b93ab1d6abc4b25916f6004a5e2b0af, user_id=1709b960bc2c4629bfabfbef9ff4b4d1, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.086708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.203177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1287/2562] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:00 2022] PUT /identity/v3/projects/0b93ab1d6abc4b25916f6004a5e2b0af/users/1709b960bc2c4629bfabfbef9ff4b4d1/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:00.207223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.208796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.272009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de71c9-fa2f-4e0f-aca3-a6e381edd187 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.326403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.327066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.327378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.327673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.328400 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.330000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.339645 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1276/2563] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:00.343830 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.354468 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fa249-3bf7-4c3d-bb5c-74201b0fd62d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.359250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eda8d-5da4-47d7-bcf4-8880c65ea1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.360160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eda8d-5da4-47d7-bcf4-8880c65ea1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.360443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eda8d-5da4-47d7-bcf4-8880c65ea1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.361381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eda8d-5da4-47d7-bcf4-8880c65ea1c8 admin admin] PATH_INFO: `/v3/projects/0b93ab1d6abc4b25916f6004a5e2b0af/users/1709b960bc2c4629bfabfbef9ff4b4d1/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.363365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eda8d-5da4-47d7-bcf4-8880c65ea1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b93ab1d6abc4b25916f6004a5e2b0af, user_id=1709b960bc2c4629bfabfbef9ff4b4d1, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.366064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eda8d-5da4-47d7-bcf4-8880c65ea1c8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.376369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.379296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.379500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1288/2564] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:00 2022] PUT /identity/v3/projects/0b93ab1d6abc4b25916f6004a5e2b0af/users/1709b960bc2c4629bfabfbef9ff4b4d1/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:00.388898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.388898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.389089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.393618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa9bc8-87f0-4ce2-b6b7-a0819a5a0a61 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.432290 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] MFA Rules not processed for user `1709b960bc2c4629bfabfbef9ff4b4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:00.433538 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.461310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.461898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.462315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.462593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] PATH_INFO: `/v3/projects/d0695fe13abc401a905fd0579770c1ad` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.463895 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0695fe13abc401a905fd0579770c1ad)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.466039 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.504209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1289/2565] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:00.515415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.516772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.572474 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097c31e-81dd-4c8a-bdcd-46923995ceae None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.585699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0695fe13abc401a905fd0579770c1ad', 'request_id': 'req-69c3a491-2c88-47ad-9077-4b25208da151'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.591244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0695fe13abc401a905fd0579770c1ad', 'request_id': 'req-69c3a491-2c88-47ad-9077-4b25208da151'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.621585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce126e83-5da4-4faf-8ed6-b2857afa8a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.622342 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce126e83-5da4-4faf-8ed6-b2857afa8a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.622631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce126e83-5da4-4faf-8ed6-b2857afa8a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.622920 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce126e83-5da4-4faf-8ed6-b2857afa8a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.671821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0695fe13abc401a905fd0579770c1ad', 'request_id': 'req-69c3a491-2c88-47ad-9077-4b25208da151'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.682978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] The token cache is being invalidate because project d0695fe13abc401a905fd0579770c1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:00.683178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce126e83-5da4-4faf-8ed6-b2857afa8a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.683502 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.684300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-69c3a491-2c88-47ad-9077-4b25208da151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:00.684599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce126e83-5da4-4faf-8ed6-b2857afa8a48 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.686009 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1277/2566] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:00 2022] DELETE /identity/v3/projects/d0695fe13abc401a905fd0579770c1ad => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:00.690845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.693381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.693381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.695991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1290/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:00.710208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:00.711395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.774329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1278/2568] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:00.780398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.780804 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.781153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.799451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:00.802030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.808438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1291/2569] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:00.812520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.823078 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a37fe8-2d4e-40c1-a9ce-fc0f35445b5a None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.836021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.836021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.836021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.836021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.836629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:00.836629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.836629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.842811 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.844295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.844639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1279/2570] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:57:00.848711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.856894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2bf86-558c-4015-9185-5bd4b87dd577 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.859779 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a62946-4bcf-4111-9651-11a485323331 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:00.862489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.863128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.863405 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.863718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.865147 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:00.865501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:00.865996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:00.866346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:00.866874 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:00.867519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.869518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.926519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:00.927994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:00.936840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1292/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:00.967430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1280/2572] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:00 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:00.968689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:00.981494 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b980b6-4378-45a2-b60b-59f8365f4914 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.040993 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.041933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.042233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.042500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.043200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.045150 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.166882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1293/2573] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:00 2022] POST /identity/v3/users => generated 303 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:01.171121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.181707 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb518994-21a0-47ed-a8ef-146ff3c688ae admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.186589 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.187300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.187584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.187977 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.188900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.190457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.200660 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1281/2574] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:01.205191 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.215475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e067d-fef6-428b-a13e-cb27afacfd4e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.220828 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2aab1-348d-43a4-b562-e1cc0454f4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.221475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2aab1-348d-43a4-b562-e1cc0454f4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.221761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2aab1-348d-43a4-b562-e1cc0454f4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.222164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2aab1-348d-43a4-b562-e1cc0454f4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.222889 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2aab1-348d-43a4-b562-e1cc0454f4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.224694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2aab1-348d-43a4-b562-e1cc0454f4b9 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.234523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1294/2575] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:01.239414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.249384 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c955ee-6fa4-4ba4-8c83-1d890ef037ee admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.255042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.265313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.265313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.265313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] PATH_INFO: `/v3/projects/495320e621ce409787cf55a829eea206/users/384cd182556749e68acc1cd50356b24f/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.271134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] RBAC: Authorizing `identity:create_grant(project_id=495320e621ce409787cf55a829eea206, user_id=384cd182556749e68acc1cd50356b24f, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.273802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.368741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1282/2576] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:01 2022] PUT /identity/v3/projects/495320e621ce409787cf55a829eea206/users/384cd182556749e68acc1cd50356b24f/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:01.380082 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.380372 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.380651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.405904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] MFA Rules not processed for user `384cd182556749e68acc1cd50356b24f`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:01.407098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:01.476668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1295/2577] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:01.481078 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.541363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a009d8f-588c-43ac-aa7f-dee31bbe569f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.546252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.546901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.547183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.547460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.548240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.550661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.667636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1283/2578] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:01 2022] POST /identity/v3/projects => generated 403 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:01.671629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.682629 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30af3b1-1f49-4f73-bb8c-92bc7a488446 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.739945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.740611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.740938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.741313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.742041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.743988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.831583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1296/2579] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:01 2022] POST /identity/v3/users => generated 308 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:01.835526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.846629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1ad21-7d23-4171-b5cc-c3ee15a87f8c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.851256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.851922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.852264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.852587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.853309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.855025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.867208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1284/2580] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:01.881691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:01.891668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86382e4-122e-4059-a880-3b916f58a9e8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:01.896822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:01.897692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:01.897970 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:01.898241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] PATH_INFO: `/v3/projects/5fbd5ac9b2034ee596d860d47a304de8/users/db49cf709e774fa7bd74cfd718ecfe70/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:01.913038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbd5ac9b2034ee596d860d47a304de8, user_id=db49cf709e774fa7bd74cfd718ecfe70, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:01.915739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:01.992252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1297/2581] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:01 2022] PUT /identity/v3/projects/5fbd5ac9b2034ee596d860d47a304de8/users/db49cf709e774fa7bd74cfd718ecfe70/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:01.996268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:02.006058 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a1868-81a2-4bfc-96ea-bdee724ef6f1 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:02.061226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a461a-83e3-437b-8594-4f199ba43642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:02.061884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a461a-83e3-437b-8594-4f199ba43642 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.062160 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a461a-83e3-437b-8594-4f199ba43642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.062430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a461a-83e3-437b-8594-4f199ba43642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.063217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a461a-83e3-437b-8594-4f199ba43642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:02.064916 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a461a-83e3-437b-8594-4f199ba43642 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:02.074269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1285/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:02.078480 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:02.089258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c1f73-b75b-4170-8779-e251bd385006 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:02.093962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:02.094831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.095112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.095393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] PATH_INFO: `/v3/projects/5fbd5ac9b2034ee596d860d47a304de8/users/db49cf709e774fa7bd74cfd718ecfe70/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.097949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbd5ac9b2034ee596d860d47a304de8, user_id=db49cf709e774fa7bd74cfd718ecfe70, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:02.100612 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:02.110713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1298/2583] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:02 2022] PUT /identity/v3/projects/5fbd5ac9b2034ee596d860d47a304de8/users/db49cf709e774fa7bd74cfd718ecfe70/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:02.120773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.121070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.121355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.147470 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] MFA Rules not processed for user `db49cf709e774fa7bd74cfd718ecfe70`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:02.148697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:02.213546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1286/2584] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:02.225460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:02.279056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7ec83-7a31-4184-a17b-ba2abd4e258f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:02.282664 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:02.283296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.284159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.284438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.293870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:02.295314 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:02.305389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1299/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:02.431488 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:02.491152 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6326a42-b4c4-4890-9f22-86185e4ac60b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:02.493432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:02.494913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:02.495568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:02.496457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.496748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.496997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] PATH_INFO: `/v3/users/384cd182556749e68acc1cd50356b24f` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.498210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384cd182556749e68acc1cd50356b24f)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:02.500141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:02.509334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b3f61-baaf-4966-a4a1-3b58ab4e4d28 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:02.514324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:02.515219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.515502 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.515822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] PATH_INFO: `/v3/users/4a98d72b92354c0d9d783ab19af70440` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.517008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a98d72b92354c0d9d783ab19af70440)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:02.518955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:02.777690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384cd182556749e68acc1cd50356b24f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.790956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a98d72b92354c0d9d783ab19af70440'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.865549 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384cd182556749e68acc1cd50356b24f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.872806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384cd182556749e68acc1cd50356b24f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.878091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384cd182556749e68acc1cd50356b24f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.878091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-cd8d0478-4d0a-45c6-8a1c-1645a1f75ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384cd182556749e68acc1cd50356b24f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.891762 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1287/2586] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:02 2022] DELETE /identity/v3/users/384cd182556749e68acc1cd50356b24f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:02.898920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.898920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.898920 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.911523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a98d72b92354c0d9d783ab19af70440'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.916538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:02.917933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:02.919687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a98d72b92354c0d9d783ab19af70440'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.920422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a98d72b92354c0d9d783ab19af70440'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.933311 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-351ffae9-daa9-4fc7-b2e2-fc3a8c735ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a98d72b92354c0d9d783ab19af70440'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:02.940313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1300/2587] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:02 2022] DELETE /identity/v3/users/4a98d72b92354c0d9d783ab19af70440 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:02.944661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:02.944953 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:02.945252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:02.961539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:02.962761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:02.976055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1288/2588] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:02.986047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:02.988008 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:03.022491 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1301/2589] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:03.033027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:03.034943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:03.054885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be961125-6bb6-453d-ab6e-9a3c75c10943 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:03.097285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b99292-577b-48ae-9c9d-8fe3454b088e None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:03.100987 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:03.101623 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.101902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.102176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.106700 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:03.107358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.107704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.107929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.112449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:03.114024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:03.118610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:03.121226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:03.124378 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1302/2590] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:03.130426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1289/2591] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:03.575866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:03.580966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:03.581115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:03.581223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:03.592587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c81e40-29bc-49c6-88dc-16f96da02903 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:03.598259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:03.599243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.599667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.600012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] PATH_INFO: `/v3/projects/495320e621ce409787cf55a829eea206` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.601278 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495320e621ce409787cf55a829eea206)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:03.601942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf0127-d02e-4907-8f59-f1dcb20c3816 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:03.603481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:03.610839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:03.611679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.611832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.615559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] PATH_INFO: `/v3/projects/1aae542610d64ee18f130c9c2d964113` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.620734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aae542610d64ee18f130c9c2d964113)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:03.622780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:03.700575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495320e621ce409787cf55a829eea206', 'request_id': 'req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.706795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495320e621ce409787cf55a829eea206', 'request_id': 'req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.809695 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aae542610d64ee18f130c9c2d964113', 'request_id': 'req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.814440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495320e621ce409787cf55a829eea206', 'request_id': 'req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.815443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aae542610d64ee18f130c9c2d964113', 'request_id': 'req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.826605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] The token cache is being invalidate because project 495320e621ce409787cf55a829eea206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:03.826829 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.827462 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.829038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1303/2592] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:03 2022] DELETE /identity/v3/projects/495320e621ce409787cf55a829eea206 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:03.833027 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:03.834300 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:03.896901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20b72d-6fa0-40b8-9b3b-6f95c8f09768 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:03.910514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aae542610d64ee18f130c9c2d964113', 'request_id': 'req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.922647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] The token cache is being invalidate because project 1aae542610d64ee18f130c9c2d964113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:03.922938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.923569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3821bb8f-7724-4fb4-88ee-eeedaf7b3d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:03.925917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1290/2593] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:03 2022] DELETE /identity/v3/projects/1aae542610d64ee18f130c9c2d964113 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:03.930313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef61a3-8fa1-46b4-bd96-85a1aa506823 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.930603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef61a3-8fa1-46b4-bd96-85a1aa506823 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.930917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef61a3-8fa1-46b4-bd96-85a1aa506823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.949453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8eef61a3-8fa1-46b4-bd96-85a1aa506823 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:03.950647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8eef61a3-8fa1-46b4-bd96-85a1aa506823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:03.951863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:03.952726 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.953006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.953276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] PATH_INFO: `/v3/users/db49cf709e774fa7bd74cfd718ecfe70` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.954448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db49cf709e774fa7bd74cfd718ecfe70)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:03.956420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:03.959052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1291/2594] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:03.968438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:03.968726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:03.968997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:03.991411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:03.992628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:04.000668 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1292/2595] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:04.006567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.013608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e2bc-2859-4f4d-89b3-71d1a441da8b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.018218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.018835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.019116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.019393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.020141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:04.020450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.022026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.032990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1293/2596] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:04.037667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.047342 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c5de1-9f05-4785-b673-c70c6baf5daa admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.052446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.053149 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.053430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.053708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.054371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.056239 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.187316 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1294/2597] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:04 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:04.191503 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.204025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db49cf709e774fa7bd74cfd718ecfe70'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:04.250783 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f336b-e624-4b4e-948f-79c3c557758b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.256155 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.256835 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.257112 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.257386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.258062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.259862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db49cf709e774fa7bd74cfd718ecfe70'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:04.260117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.267378 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db49cf709e774fa7bd74cfd718ecfe70'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:04.276130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db49cf709e774fa7bd74cfd718ecfe70'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:04.279669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db49cf709e774fa7bd74cfd718ecfe70'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:04.285438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1304/2598] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:03 2022] DELETE /identity/v3/users/db49cf709e774fa7bd74cfd718ecfe70 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:04.392001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1295/2599] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:04 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:04.396094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.397484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:04.461116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0a44a-f01d-46d4-9d56-2606b49407b3 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.465875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.466541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.466819 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.467090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.467841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.469428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.483513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1305/2600] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:04.487407 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.497609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea9bd1-8521-4976-a194-4cfcc56ed3b6 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.502887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f8536-e373-493a-b2e4-8ac2271110d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.503580 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f8536-e373-493a-b2e4-8ac2271110d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.503886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f8536-e373-493a-b2e4-8ac2271110d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.504157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f8536-e373-493a-b2e4-8ac2271110d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.504882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f8536-e373-493a-b2e4-8ac2271110d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.506483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f8536-e373-493a-b2e4-8ac2271110d1 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.516697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1296/2601] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:04.520790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.530843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38986523-ed56-4f3a-a810-007712a84066 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.536022 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.536898 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.537175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.537447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] PATH_INFO: `/v3/projects/3a2ba740c0534d63ae1dbf7eac1f360a/users/bc265566130848f19808a608f389c652/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.552799 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2ba740c0534d63ae1dbf7eac1f360a, user_id=bc265566130848f19808a608f389c652, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.555430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.648497 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1306/2602] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:04 2022] PUT /identity/v3/projects/3a2ba740c0534d63ae1dbf7eac1f360a/users/bc265566130848f19808a608f389c652/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:04.659261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.659548 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.659876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.684030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.685845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:04.686955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] MFA Rules not processed for user `bc265566130848f19808a608f389c652`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:04.688216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:04.759965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1297/2603] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:04.766738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:04.772574 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e1cd-7239-4f57-b2b0-68ae55330147 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.777287 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3fb17-bb8d-44ce-a68a-f0026b7e868c None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:04.777496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.778292 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.778568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.778842 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] PATH_INFO: `/v3/projects/5fbd5ac9b2034ee596d860d47a304de8` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.780241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbd5ac9b2034ee596d860d47a304de8)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.782291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.787205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:04.788232 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:04.788361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:04.788655 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:04.789414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:04.791918 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:04.981643 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1298/2604] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:04 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:04.987440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.006513 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbd5ac9b2034ee596d860d47a304de8', 'request_id': 'req-a470919f-8c79-42fb-a4c9-cff533027113'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:05.011956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbd5ac9b2034ee596d860d47a304de8', 'request_id': 'req-a470919f-8c79-42fb-a4c9-cff533027113'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:05.053471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b1653-dc6a-4718-8cf5-4c50e659cdf4 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.105572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbd5ac9b2034ee596d860d47a304de8', 'request_id': 'req-a470919f-8c79-42fb-a4c9-cff533027113'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:05.106737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.107397 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.107714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.107983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.108661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.110574 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.117324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] The token cache is being invalidate because project 5fbd5ac9b2034ee596d860d47a304de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:05.117614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:05.118239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-a470919f-8c79-42fb-a4c9-cff533027113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:05.119839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1307/2605] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:04 2022] DELETE /identity/v3/projects/5fbd5ac9b2034ee596d860d47a304de8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:05.124831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f51cf1-3dfa-450e-9e7e-a18136f855d9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.125118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f51cf1-3dfa-450e-9e7e-a18136f855d9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.125397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f51cf1-3dfa-450e-9e7e-a18136f855d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.143826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-71f51cf1-3dfa-450e-9e7e-a18136f855d9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:05.145733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-71f51cf1-3dfa-450e-9e7e-a18136f855d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:05.153030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1308/2606] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:05.161412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.161614 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.161890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.187894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:05.189088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:05.197141 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1299/2608] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:04 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:05.197525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1309/2608] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:05.201034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.201192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.202683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:05.210471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ea39-492c-4509-a824-42ff967213c9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.214662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55d64a-a243-4cfc-87a1-70fbe6d71c68 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.215270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.215939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.216229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.216485 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.217201 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:05.217505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.219077 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.219592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.220271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.220560 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.220859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.222177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.223810 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.232789 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1310/2609] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:57:05.234627 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1300/2610] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:05.237358 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.240541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.246988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c3dfd-f313-4074-9907-dc40564017d0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.250330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048298e8-b618-47d0-ae32-a985fe03a3da admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.251713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.252964 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.253257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.253534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.254230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.255975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.256151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.256641 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.256928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.257204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.257926 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.259513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.269962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1301/2611] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:05.273967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.284041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb6c72-4b80-412f-8c0c-5dd9b9c8dfd9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.288781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5d48e-5411-4845-b08f-b384d66fa43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.289697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d48e-5411-4845-b08f-b384d66fa43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.290001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d48e-5411-4845-b08f-b384d66fa43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.290276 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5d48e-5411-4845-b08f-b384d66fa43b admin admin] PATH_INFO: `/v3/projects/72807a6d94444a8ebd18dd2f546415fc/users/cf435c72e5a348f8bf50c8b3291a7904/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.305798 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5d48e-5411-4845-b08f-b384d66fa43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72807a6d94444a8ebd18dd2f546415fc, user_id=cf435c72e5a348f8bf50c8b3291a7904, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.308496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5d48e-5411-4845-b08f-b384d66fa43b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.398566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1311/2612] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:05.402610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.420458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1302/2613] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:05 2022] PUT /identity/v3/projects/72807a6d94444a8ebd18dd2f546415fc/users/cf435c72e5a348f8bf50c8b3291a7904/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:05.433115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.433401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.433708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.461773 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] MFA Rules not processed for user `cf435c72e5a348f8bf50c8b3291a7904`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:05.462983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:05.465896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b397f8-853f-438e-8e73-bc40a035dd3e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.525505 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.526176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.526455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.527109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.527772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.529619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.532030 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1303/2614] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:05.537206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.548153 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c267ac-2170-45c2-8445-8310045949a9 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.553434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.554076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.554355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.554624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.555307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.557266 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.608448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1312/2615] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:05.612884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.622159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9696f-4897-41d3-8709-29640ac5175b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.626668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.627311 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.627591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.627890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.628602 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.630197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.639771 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1313/2616] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:05.643945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.653154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701f95-0f73-430c-86c2-23a1ace893e0 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.665047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.665047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.665047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.665047 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.665481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.665481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.671845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1314/2617] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:05.675465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.684529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a20dd-76a3-4817-bf38-b817038656a8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.689044 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444082d-de7d-4c87-b060-6ce5ee2ee8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.689915 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444082d-de7d-4c87-b060-6ce5ee2ee8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.690105 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1304/2618] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:05.693195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444082d-de7d-4c87-b060-6ce5ee2ee8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.693508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444082d-de7d-4c87-b060-6ce5ee2ee8bd admin admin] PATH_INFO: `/v3/projects/26083f1c900246eea968c8c05e043277/users/c6b296339f3240b491ae6b3c87e677d9/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.694362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.709051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444082d-de7d-4c87-b060-6ce5ee2ee8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26083f1c900246eea968c8c05e043277, user_id=c6b296339f3240b491ae6b3c87e677d9, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.716800 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444082d-de7d-4c87-b060-6ce5ee2ee8bd admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.756325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c548a-3306-46e3-9975-e7e721b86054 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.760929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.761653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.761872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.762148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.762832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.764832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.815216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1315/2619] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:05 2022] PUT /identity/v3/projects/26083f1c900246eea968c8c05e043277/users/c6b296339f3240b491ae6b3c87e677d9/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:05.826353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.826634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.826935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.851882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] MFA Rules not processed for user `c6b296339f3240b491ae6b3c87e677d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:05.853072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:05.905973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1305/2620] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:05.910117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.914988 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1316/2621] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:05.919824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5643666-40d1-49e9-a58f-ff81f91dcf8d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.922362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:05.988858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.989613 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.990138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.990599 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.992455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278270e9-cebe-4cfa-9dad-013877528494 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:05.998339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:05.998339 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:05.998546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:05.998546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:05.998546 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:05.998881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:05.999577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.001490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.006646 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1306/2622] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:06.011853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.021752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e540-64dd-4329-abf9-37ac037f0a54 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.026409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.027837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.027837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.028055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] PATH_INFO: `/v3/projects/a890954c8dcb43c3adee0a0454892ff2/users/90dbd12d6a264f6eb25308241b01f7a6/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.043145 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a890954c8dcb43c3adee0a0454892ff2, user_id=90dbd12d6a264f6eb25308241b01f7a6, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.045831 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.107069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1317/2623] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:05 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:06.108487 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.109806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.134325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1307/2624] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:06 2022] PUT /identity/v3/projects/a890954c8dcb43c3adee0a0454892ff2/users/90dbd12d6a264f6eb25308241b01f7a6/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:06.137186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.175139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d8d2a-b9b0-4a88-b550-4e6141b8e31a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.195523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8bc32-9ba3-4af0-a4ba-7abc700c7de6 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.200157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.200828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.201107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.201380 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.202094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.204044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.230039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.232852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.232852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.232852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] PATH_INFO: `/v3/users/dde7a58466cc409c8225e6462e9287b7` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.232852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde7a58466cc409c8225e6462e9287b7)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.234596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.300755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1308/2625] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:06 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:06.301615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.311336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349258-af59-4ffb-9f54-787677f565a5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.316279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.316917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.317244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.317539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.318315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.320022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.329771 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1309/2626] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:06.333095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.340010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f598c0-83f2-499a-8a1c-f4950825c272 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.344576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.345201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.345483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.345758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.346978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.348568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.358830 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1310/2627] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:06.359569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.369286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c644b7-3112-4a3e-8d7a-8b5d74f8a4e7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.373882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.378957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.378957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.378957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] PATH_INFO: `/v3/projects/a890954c8dcb43c3adee0a0454892ff2/users/90dbd12d6a264f6eb25308241b01f7a6/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.378957 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a890954c8dcb43c3adee0a0454892ff2, user_id=90dbd12d6a264f6eb25308241b01f7a6, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.379804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.390014 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1311/2628] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:06 2022] PUT /identity/v3/projects/a890954c8dcb43c3adee0a0454892ff2/users/90dbd12d6a264f6eb25308241b01f7a6/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:06.390824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.450893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54082b41-d285-498e-8190-4fc8ac7e4b48 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.455534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb908-05f3-441c-8d13-ec218207ef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.456427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb908-05f3-441c-8d13-ec218207ef32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.456703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb908-05f3-441c-8d13-ec218207ef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.456973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb908-05f3-441c-8d13-ec218207ef32 admin admin] PATH_INFO: `/v3/projects/f5b2ea18b7bf4986b3774f7e2fc093b5/users/3093bf729b8a4408b100d027bc665eab/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.467183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde7a58466cc409c8225e6462e9287b7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:06.471469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb908-05f3-441c-8d13-ec218207ef32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b2ea18b7bf4986b3774f7e2fc093b5, user_id=3093bf729b8a4408b100d027bc665eab, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.476686 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb908-05f3-441c-8d13-ec218207ef32 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.591396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde7a58466cc409c8225e6462e9287b7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:06.598592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde7a58466cc409c8225e6462e9287b7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:06.599220 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde7a58466cc409c8225e6462e9287b7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:06.608341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1312/2629] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:06 2022] PUT /identity/v3/projects/f5b2ea18b7bf4986b3774f7e2fc093b5/users/3093bf729b8a4408b100d027bc665eab/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:06.609669 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501231c2-7d3a-4aea-925b-ca0d662dd5f5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.610195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501231c2-7d3a-4aea-925b-ca0d662dd5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.610195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501231c2-7d3a-4aea-925b-ca0d662dd5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.611289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde7a58466cc409c8225e6462e9287b7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:06.618030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1318/2630] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:06 2022] DELETE /identity/v3/users/dde7a58466cc409c8225e6462e9287b7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:06.619084 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.622540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.637337 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-501231c2-7d3a-4aea-925b-ca0d662dd5f5 None None] MFA Rules not processed for user `90dbd12d6a264f6eb25308241b01f7a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:06.638523 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-501231c2-7d3a-4aea-925b-ca0d662dd5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.685919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c082747-91d3-402d-a785-53de70d1b7a4 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.691213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.692836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.692836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.692836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.693509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.695114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.703931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1313/2631] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:06.707994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1319/2632] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:06.708173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.708173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.708173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.711738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.721660 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93ec5-194a-49a3-8e4d-ac8586dd83d2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.723091 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:06.724309 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.726638 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.727517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.727836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.728112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] PATH_INFO: `/v3/projects/f5b2ea18b7bf4986b3774f7e2fc093b5/users/3093bf729b8a4408b100d027bc665eab/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.730145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b2ea18b7bf4986b3774f7e2fc093b5, user_id=3093bf729b8a4408b100d027bc665eab, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.731850 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1314/2633] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:06.732610 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.732837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.733851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.744270 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1320/2634] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:06 2022] PUT /identity/v3/projects/f5b2ea18b7bf4986b3774f7e2fc093b5/users/3093bf729b8a4408b100d027bc665eab/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:06.745072 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:06.746611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.795015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff5725-6b1e-4d2f-82ba-8d8e69d66a65 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.808956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148fa0a-522d-40de-be22-7cb0dd8b1482 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:06.812662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d798d07-70b4-4536-99ed-84b9fae7bbb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.813392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798d07-70b4-4536-99ed-84b9fae7bbb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.813687 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798d07-70b4-4536-99ed-84b9fae7bbb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.813958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d798d07-70b4-4536-99ed-84b9fae7bbb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.842507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:06.843070 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.843354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.843653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.845426 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.872521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798d07-70b4-4536-99ed-84b9fae7bbb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.873962 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d798d07-70b4-4536-99ed-84b9fae7bbb8 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.883258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1321/2635] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:06.884722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:06.885013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:06.885289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:06.902519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:06.904531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:06.914089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] MFA Rules not processed for user `3093bf729b8a4408b100d027bc665eab`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:06.915310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:06.917304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1315/2636] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:06.987991 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1322/2637] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:06.999486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:07.001074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:07.012007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203ce09-197a-4f81-b6fc-21dbb239bde7 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:07.015965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:07.016725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:07.017110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:07.017474 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:07.026659 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:07.028310 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:07.038849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1316/2638] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:07.067350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:07.077859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1061b-33d5-42cd-8fd0-cdf76d28a722 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:07.082955 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:07.083944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:07.084382 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:07.084707 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] PATH_INFO: `/v3/users/c6b296339f3240b491ae6b3c87e677d9` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:07.085998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b296339f3240b491ae6b3c87e677d9)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:07.088309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:07.307944 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:07.309405 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:07.324547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a301f30-b21e-4c6a-bd1f-8dbfc74a5926 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:07.329769 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:07.332171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:07.332171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:07.332171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] PATH_INFO: `/v3/projects/343fca68bf0941babf525ccc76b25ba5` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:07.332674 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=343fca68bf0941babf525ccc76b25ba5)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:07.334675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:07.345244 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b296339f3240b491ae6b3c87e677d9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.442600 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b296339f3240b491ae6b3c87e677d9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.449872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b296339f3240b491ae6b3c87e677d9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.450507 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b296339f3240b491ae6b3c87e677d9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.461837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-24752221-dbd1-4857-9a11-7b41183183a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b296339f3240b491ae6b3c87e677d9'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.467587 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1323/2639] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:07 2022] DELETE /identity/v3/users/c6b296339f3240b491ae6b3c87e677d9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:07.472110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:07.472396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:07.472671 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:07.489420 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343fca68bf0941babf525ccc76b25ba5', 'request_id': 'req-733be6da-effe-46d1-b486-73b3eb440e37'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.489918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:07.491142 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:07.495026 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343fca68bf0941babf525ccc76b25ba5', 'request_id': 'req-733be6da-effe-46d1-b486-73b3eb440e37'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.547978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1324/2640] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:07.558312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:07.559577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:07.601845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343fca68bf0941babf525ccc76b25ba5', 'request_id': 'req-733be6da-effe-46d1-b486-73b3eb440e37'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.613170 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] The token cache is being invalidate because project 343fca68bf0941babf525ccc76b25ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:07.613559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.614300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.615990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1317/2641] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:07 2022] DELETE /identity/v3/projects/343fca68bf0941babf525ccc76b25ba5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:07.619883 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:07.620369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffa1c1-8bf6-4260-86bd-4744b9b9e07f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:07.621252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:07.624445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:07.625143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:07.625499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:07.625865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:07.627878 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:07.640062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733be6da-effe-46d1-b486-73b3eb440e37 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:07.640062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:07.640994 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:07.641159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:07.641484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:07.641945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] PATH_INFO: `/v3/users/1709b960bc2c4629bfabfbef9ff4b4d1` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:07.642530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:07.643425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1709b960bc2c4629bfabfbef9ff4b4d1)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:07.645441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:07.652091 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1325/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:07.840555 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1709b960bc2c4629bfabfbef9ff4b4d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.917526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1709b960bc2c4629bfabfbef9ff4b4d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.925713 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1709b960bc2c4629bfabfbef9ff4b4d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.926417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1709b960bc2c4629bfabfbef9ff4b4d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.927726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1709b960bc2c4629bfabfbef9ff4b4d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:07.944205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1318/2643] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:07 2022] DELETE /identity/v3/users/1709b960bc2c4629bfabfbef9ff4b4d1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:08.073412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:08.074858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:08.092273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe2a6-c5c3-40e6-8f48-26ff5f8e6698 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:08.151444 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:08.154717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.154717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.154717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] PATH_INFO: `/v3/projects/26083f1c900246eea968c8c05e043277` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.154717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=26083f1c900246eea968c8c05e043277)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:08.156029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:08.311831 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26083f1c900246eea968c8c05e043277', 'request_id': 'req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.317621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26083f1c900246eea968c8c05e043277', 'request_id': 'req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.368682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26083f1c900246eea968c8c05e043277', 'request_id': 'req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.380008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] The token cache is being invalidate because project 26083f1c900246eea968c8c05e043277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:08.380230 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.380840 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.382475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1326/2644] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:08 2022] DELETE /identity/v3/projects/26083f1c900246eea968c8c05e043277 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:08.386653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:08.388085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:08.400791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143faa2b-fb32-4733-8111-e69e79b67851 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:08.440611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:08.443190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:08.462796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:08.466076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.466076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.466076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] PATH_INFO: `/v3/users/3093bf729b8a4408b100d027bc665eab` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.466076 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3093bf729b8a4408b100d027bc665eab)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:08.467854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:08.509790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f99421-cc9f-4ed2-b772-f530cc9a4fdf admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:08.514356 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:08.517658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.517658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.517658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] PATH_INFO: `/v3/projects/0b93ab1d6abc4b25916f6004a5e2b0af` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.517658 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b93ab1d6abc4b25916f6004a5e2b0af)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:08.518909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:08.650956 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b93ab1d6abc4b25916f6004a5e2b0af', 'request_id': 'req-084e933f-8c20-4bad-b392-2008f600142d'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.651200 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3093bf729b8a4408b100d027bc665eab'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.657883 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b93ab1d6abc4b25916f6004a5e2b0af', 'request_id': 'req-084e933f-8c20-4bad-b392-2008f600142d'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.710326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3093bf729b8a4408b100d027bc665eab'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.717837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3093bf729b8a4408b100d027bc665eab'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.718529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3093bf729b8a4408b100d027bc665eab'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.719148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-f9b309ab-7b72-4f5b-a815-9cba322b6c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3093bf729b8a4408b100d027bc665eab'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.742789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1319/2645] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:08 2022] DELETE /identity/v3/users/3093bf729b8a4408b100d027bc665eab => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:08.795969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b93ab1d6abc4b25916f6004a5e2b0af', 'request_id': 'req-084e933f-8c20-4bad-b392-2008f600142d'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.808223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] The token cache is being invalidate because project 0b93ab1d6abc4b25916f6004a5e2b0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:08.808622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.809283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-084e933f-8c20-4bad-b392-2008f600142d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:08.810853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1327/2646] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:08 2022] DELETE /identity/v3/projects/0b93ab1d6abc4b25916f6004a5e2b0af => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:08.816955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.817245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.817527 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.836085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:08.837396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:08.894452 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1320/2647] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:08.903063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.903349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.903643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.922285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:08.923634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:08.932136 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1328/2648] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:08.936383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:08.946846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6376-685a-424d-bd7a-afd8cab4de47 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:08.952154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:08.952826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.953115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.953387 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.954129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:08.954430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:08.956122 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:08.968552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1321/2649] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:08.972678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:08.988390 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7d5ed-381f-4f5f-a6a1-789fc63f0a3c None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:08.992446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:08.993738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:08.994097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:08.994431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:08.995210 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:08.997929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.034489 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.036358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.107118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1329/2650] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:08 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:09.107359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f02872-1fb6-4bda-a1d2-40735578c2c9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.109113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.157289 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.157955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.158793 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.159090 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.160906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.188467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ad5c9-b712-4838-9c33-7e7f2e8294b1 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.193469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.194139 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.194423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.194705 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.195398 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.201521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.228753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.230330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.240247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1322/2651] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:09.242388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.242512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.256587 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf91a58-e8ec-4699-8b13-c313c3c291c4 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.262244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.263215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.263594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.264011 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] PATH_INFO: `/v3/projects/f5b2ea18b7bf4986b3774f7e2fc093b5` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.265226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b2ea18b7bf4986b3774f7e2fc093b5)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.267138 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.292803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1330/2652] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:09 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:09.293855 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.304280 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22750c4-08b5-499a-a036-1f415bdddefe admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.309034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.309682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.309961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.310229 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.310973 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.312619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.323045 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1331/2653] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:09.327004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.336652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c706a3-8f35-4f60-b88c-f94aa26dd38d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.341171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.341795 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.342075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.342348 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.343049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.344772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.355483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1332/2654] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:09.359383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.369389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dc1fa-da94-4e6a-a02b-c463b63995d2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.374113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75637c21-3b3c-4e13-a46c-9243e6c38c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.374961 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75637c21-3b3c-4e13-a46c-9243e6c38c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.375303 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75637c21-3b3c-4e13-a46c-9243e6c38c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.375515 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75637c21-3b3c-4e13-a46c-9243e6c38c8b admin admin] PATH_INFO: `/v3/projects/caa4821e2f4e484ea42f29fbf06bf7b2/users/aa363826eb2d43e197782cec6fddd229/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.390110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75637c21-3b3c-4e13-a46c-9243e6c38c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa4821e2f4e484ea42f29fbf06bf7b2, user_id=aa363826eb2d43e197782cec6fddd229, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.390292 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b2ea18b7bf4986b3774f7e2fc093b5', 'request_id': 'req-c9be7525-e37c-4fea-83d1-dc15f0752dbf'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:09.395208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75637c21-3b3c-4e13-a46c-9243e6c38c8b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.396259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b2ea18b7bf4986b3774f7e2fc093b5', 'request_id': 'req-c9be7525-e37c-4fea-83d1-dc15f0752dbf'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:09.499445 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1333/2655] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:09 2022] PUT /identity/v3/projects/caa4821e2f4e484ea42f29fbf06bf7b2/users/aa363826eb2d43e197782cec6fddd229/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:09.509379 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.509663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.509937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.533308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b2ea18b7bf4986b3774f7e2fc093b5', 'request_id': 'req-c9be7525-e37c-4fea-83d1-dc15f0752dbf'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:09.536007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] MFA Rules not processed for user `aa363826eb2d43e197782cec6fddd229`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:09.537081 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.546446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] The token cache is being invalidate because project f5b2ea18b7bf4986b3774f7e2fc093b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:09.550571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:09.550571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-c9be7525-e37c-4fea-83d1-dc15f0752dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:09.550571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1323/2656] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:09 2022] DELETE /identity/v3/projects/f5b2ea18b7bf4986b3774f7e2fc093b5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:09.554046 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad96df-5d51-4b59-a67f-f6e60ac280a1 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.554336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad96df-5d51-4b59-a67f-f6e60ac280a1 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.554617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad96df-5d51-4b59-a67f-f6e60ac280a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.572320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-41ad96df-5d51-4b59-a67f-f6e60ac280a1 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:09.573507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-41ad96df-5d51-4b59-a67f-f6e60ac280a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.605188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1334/2657] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:09.616339 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.617714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.633127 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1324/2658] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:09.640703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.640989 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.641305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.661608 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:09.662975 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.670873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1325/2659] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:09.675768 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47848d-a13e-4007-9f6e-351b9850c5a9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.678672 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.679025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.679699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.680165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.680448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.688041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b9b26-2102-4d63-b73d-90910be27136 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.689352 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.691223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.695453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.696135 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.696416 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.696690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.697413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:09.697716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.699349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.700561 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1335/2660] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:09.711588 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1326/2661] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:09.716282 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.719905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.722144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:09.728023 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7be8d-b0bd-471d-a3b6-25353621855c service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.732650 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.733295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.733634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.733911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.734436 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fea2b-5e48-4bbc-adcf-2fae6cb36f7f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.734622 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.737052 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.740829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.742142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.742541 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.743027 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] PATH_INFO: `/v3/users/aa363826eb2d43e197782cec6fddd229` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.744755 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa363826eb2d43e197782cec6fddd229)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.747811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.882930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1336/2662] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:09 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:09.887094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:09.946463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ce08e-d134-4632-95e8-c28a8b1c3ef7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:09.951247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:09.951969 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:09.952247 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:09.952521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:09.953203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:09.955174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:09.999547 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa363826eb2d43e197782cec6fddd229'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.077455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1337/2663] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:09 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:10.082006 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.091764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2f1b8-1e1e-45c1-b7ea-62044ab8f2d2 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.097167 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.097838 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.098120 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.098395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.099128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.100767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.115551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa363826eb2d43e197782cec6fddd229'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.115735 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1338/2664] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:10.115839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa363826eb2d43e197782cec6fddd229'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.115839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa363826eb2d43e197782cec6fddd229'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.115839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3389e000-80d5-4947-83b8-4d6d25addf93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa363826eb2d43e197782cec6fddd229'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.116554 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.118268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.132282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1327/2665] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:09 2022] DELETE /identity/v3/users/aa363826eb2d43e197782cec6fddd229 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:10.132452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700b2d4-21a7-4f72-b343-5edb2d906747 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.136485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.136786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.136991 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.154471 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:10.155710 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.189475 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.190155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.190471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.190744 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.191471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.193095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.202655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1339/2666] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:10.207473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.215388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1328/2667] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:10.220214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3b82e-80cf-43cb-b12b-0736d163c312 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.225509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.225681 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.226387 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.226669 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.226938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.227041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] PATH_INFO: `/v3/projects/1a2b4abcac5b413ba593a0e548d2f250/users/5d6571d018634d94b9e45227fd6a0c0b/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.242060 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2b4abcac5b413ba593a0e548d2f250, user_id=5d6571d018634d94b9e45227fd6a0c0b, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.244816 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.283717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d139ac-b017-403a-bfff-f8575653a7e7 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.287422 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f55a2-3490-44fe-b871-7364ca79f8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.288103 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f55a2-3490-44fe-b871-7364ca79f8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.288386 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f55a2-3490-44fe-b871-7364ca79f8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.288662 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f55a2-3490-44fe-b871-7364ca79f8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.297853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f55a2-3490-44fe-b871-7364ca79f8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.299871 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f55a2-3490-44fe-b871-7364ca79f8a3 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.309181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1329/2668] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:10.368772 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1340/2669] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:10 2022] PUT /identity/v3/projects/1a2b4abcac5b413ba593a0e548d2f250/users/5d6571d018634d94b9e45227fd6a0c0b/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:10.380079 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.380391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.380789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.408084 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] MFA Rules not processed for user `5d6571d018634d94b9e45227fd6a0c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:10.409891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.473000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1330/2670] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:10.481632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.555376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed6571-0198-47ae-9589-45e3cca9e820 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.560310 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.561007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.561364 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.561572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.562269 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.564248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.689661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1341/2671] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:10 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:10.693022 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.703393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cbda0-d02d-4003-b4eb-092b8cf5bb6e None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.725518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.732037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.781150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.782424 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.782794 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.783077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.784320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.787111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.813663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d4687-1095-4075-b512-c6fe2d7f09dc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.818570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.819432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.819752 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.820138 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] PATH_INFO: `/v3/projects/caa4821e2f4e484ea42f29fbf06bf7b2` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.821334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa4821e2f4e484ea42f29fbf06bf7b2)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:10.823274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:10.867102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1331/2672] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:10 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:10.868184 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:10.869805 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.923728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa4821e2f4e484ea42f29fbf06bf7b2', 'request_id': 'req-da11c6ce-5375-4829-a336-8846109971e7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.925066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4b7ef-3096-4bca-83c8-f69e3070c490 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:10.929024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa4821e2f4e484ea42f29fbf06bf7b2', 'request_id': 'req-da11c6ce-5375-4829-a336-8846109971e7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:10.972265 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:10.972899 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:10.973180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:10.973456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:10.975399 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:10.996994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa4821e2f4e484ea42f29fbf06bf7b2', 'request_id': 'req-da11c6ce-5375-4829-a336-8846109971e7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:11.008877 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] The token cache is being invalidate because project caa4821e2f4e484ea42f29fbf06bf7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:11.009165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:11.009820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:11.011704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1342/2673] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:10 2022] DELETE /identity/v3/projects/caa4821e2f4e484ea42f29fbf06bf7b2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:11.012588 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.013906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:11.038275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.039756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c92bb0-de32-41a1-8dc2-318e28de27e2 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.049852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1332/2674] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:11.051017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fd2c-fd63-4d4e-b85d-011b72630e6a None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.051303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fd2c-fd63-4d4e-b85d-011b72630e6a None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.051584 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122fd2c-fd63-4d4e-b85d-011b72630e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.069702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1122fd2c-fd63-4d4e-b85d-011b72630e6a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:11.070901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1122fd2c-fd63-4d4e-b85d-011b72630e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:11.079301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1333/2675] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:11.084666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11c6ce-5375-4829-a336-8846109971e7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.087349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.087749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.088029 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.090122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.090783 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.091182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.091463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.092225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.093822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.104751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1343/2676] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:11.107430 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:11.108637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:11.108843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.118757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40db3ed-ffe9-417a-a105-2dda44664790 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.119121 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1334/2677] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:11.123530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.124451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.124731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.127984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] PATH_INFO: `/v3/projects/8cbe8c2ce7014c8e92401e1c120c66cb/users/a9ca032dd36d49b8910d63a358b16201/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.130990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.140308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93692c38-1e1c-4d4f-81cb-527f7306ce43 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.140637 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbe8c2ce7014c8e92401e1c120c66cb, user_id=a9ca032dd36d49b8910d63a358b16201, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.143986 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.150109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.150109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.150109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.150109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.150512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:11.150512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.150512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.161978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1335/2678] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:11.166492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.176480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126443ff-a7be-4c42-aa88-8672925783df admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.181234 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.181859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.182140 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.182414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.183093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.185015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.219695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1344/2679] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:11 2022] PUT /identity/v3/projects/8cbe8c2ce7014c8e92401e1c120c66cb/users/a9ca032dd36d49b8910d63a358b16201/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:11.225309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.286959 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24092-fdb3-4e9a-a8e1-83c5d464984f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.299967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1336/2680] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:11.300093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.300093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.300093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.300093 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.300467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.300467 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.302758 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.306925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1345/2681] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:11.310632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.320417 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e15d3-7a40-4679-a368-614c540a25f6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.374591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c8c7f-bf49-408b-8c05-cc377937207c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.374591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.374591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.374591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.374921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.374921 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.376695 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdbfb7-13b3-4f5a-b561-41a3ac4387ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.376905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.377606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdbfb7-13b3-4f5a-b561-41a3ac4387ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.377888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdbfb7-13b3-4f5a-b561-41a3ac4387ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.378208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdbfb7-13b3-4f5a-b561-41a3ac4387ca admin admin] PATH_INFO: `/v3/projects/8cbe8c2ce7014c8e92401e1c120c66cb/users/a9ca032dd36d49b8910d63a358b16201/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.380176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdbfb7-13b3-4f5a-b561-41a3ac4387ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cbe8c2ce7014c8e92401e1c120c66cb, user_id=a9ca032dd36d49b8910d63a358b16201, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.382766 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdbfb7-13b3-4f5a-b561-41a3ac4387ca admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.392792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1346/2682] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:11 2022] PUT /identity/v3/projects/8cbe8c2ce7014c8e92401e1c120c66cb/users/a9ca032dd36d49b8910d63a358b16201/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:11.402589 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.402919 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.403175 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.431820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] MFA Rules not processed for user `a9ca032dd36d49b8910d63a358b16201`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:11.433032 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:11.489369 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1337/2683] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:11.493295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.502779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1347/2684] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:11.503261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d6cdc-7525-4e50-8e36-7c4b292873c7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.514890 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.516391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:11.559845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.560604 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.560886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.561210 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.561969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.563597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.571862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a11751-7428-4e64-9f63-f2969e96a617 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.573333 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1338/2685] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:11.575822 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.590560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.590560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.590560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.590890 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.591007 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.591118 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb0cbe-0553-44a5-8cd1-6055bbec576f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.591214 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.591594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74c7b4-dfde-4a38-b1cc-d9d080f11dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.592250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74c7b4-dfde-4a38-b1cc-d9d080f11dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.592532 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74c7b4-dfde-4a38-b1cc-d9d080f11dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.592807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74c7b4-dfde-4a38-b1cc-d9d080f11dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.593519 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74c7b4-dfde-4a38-b1cc-d9d080f11dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.595116 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74c7b4-dfde-4a38-b1cc-d9d080f11dbd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.597749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1348/2686] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:11.606836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1339/2687] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:11.610906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.621674 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941b87-99f4-4c4d-b165-120c22746dac service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.627041 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.628000 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.628297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.628572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] PATH_INFO: `/v3/projects/f785efb80b62468999c3a8f6336df95e/users/d9146573871b48d0a5196f279ca8cca3/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.644458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f785efb80b62468999c3a8f6336df95e, user_id=d9146573871b48d0a5196f279ca8cca3, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.647166 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:11.730322 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1349/2688] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:11 2022] PUT /identity/v3/projects/f785efb80b62468999c3a8f6336df95e/users/d9146573871b48d0a5196f279ca8cca3/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:11.742237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.743915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.744226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.771362 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] MFA Rules not processed for user `d9146573871b48d0a5196f279ca8cca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:11.772636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:11.848444 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1340/2689] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:11.852809 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:11.923521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531247f-4008-4494-96bb-02de1d2334e8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:11.930679 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874058-a338-4444-9f02-525809f1993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:11.931331 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874058-a338-4444-9f02-525809f1993b admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:11.931624 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874058-a338-4444-9f02-525809f1993b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:11.931911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874058-a338-4444-9f02-525809f1993b admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:11.932663 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874058-a338-4444-9f02-525809f1993b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:11.934642 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874058-a338-4444-9f02-525809f1993b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.045074 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1350/2690] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:11 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:12.051123 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.062679 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e26b6-c19e-4370-9ccb-f955830822b8 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.122955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.124451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.124738 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.125015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.125817 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.127867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.271443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1341/2691] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:12 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:12.277203 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874058-a338-4444-9f02-525809f1993b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.287503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874058-a338-4444-9f02-525809f1993b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.292420 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.293118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.293391 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.293673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.294393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.296145 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.307209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1351/2692] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:12.311554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.324259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b74e2c-bc74-4954-86be-3435273b75c0 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.331226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4c2f-3f51-4d9a-b76a-bd513680173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.332001 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4c2f-3f51-4d9a-b76a-bd513680173c admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.332347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4c2f-3f51-4d9a-b76a-bd513680173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.332689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4c2f-3f51-4d9a-b76a-bd513680173c admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.333482 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4c2f-3f51-4d9a-b76a-bd513680173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.335117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4c2f-3f51-4d9a-b76a-bd513680173c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.347261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1342/2693] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:12.351784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.361596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd654f-56f7-4ce6-8e0c-2de3b7f65268 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.366291 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.368570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.368865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.369149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] PATH_INFO: `/v3/projects/d1745e140dbf4882ab21521a904b7bac/users/58030a4660a54f6f9c23aa5bf33b0efc/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.385839 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1745e140dbf4882ab21521a904b7bac, user_id=58030a4660a54f6f9c23aa5bf33b0efc, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.388560 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.502122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1352/2694] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:12 2022] PUT /identity/v3/projects/d1745e140dbf4882ab21521a904b7bac/users/58030a4660a54f6f9c23aa5bf33b0efc/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:12.515129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.515663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.515789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.543586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] MFA Rules not processed for user `58030a4660a54f6f9c23aa5bf33b0efc`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:12.544832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:12.607917 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1343/2695] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:12.613025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.664326 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.684202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405554aa-fb74-4dae-bbbb-9f6bbf116367 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.689156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.690784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.690784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.691010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.691665 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.693610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.726833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a2c93-0c3c-4e53-83c4-eab67cf49c29 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.731556 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ca032dd36d49b8910d63a358b16201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbe8c2ce7014c8e92401e1c120c66cb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.732259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.732550 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.732911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.733626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:12.733940 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.735592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.750159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1344/2696] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:57:12.751789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.761832 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afb2b8-9592-49e3-9921-2c643d526bd0 tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.766353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ca032dd36d49b8910d63a358b16201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbe8c2ce7014c8e92401e1c120c66cb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.766996 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.767300 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.767576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.768299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.770156 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.787704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1353/2697] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:12 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:12.791551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.852366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce04c8f-0570-49ee-9b25-5ff88b9f228e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.857048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.857741 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.858128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.858350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.859039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.861079 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.883220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1345/2698] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:12 2022] POST /identity/v3/projects => generated 352 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:12.887129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:12.947845 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b35a8-1b55-4de0-9ef9-ee0edfc1f13c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:12.952450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ca032dd36d49b8910d63a358b16201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbe8c2ce7014c8e92401e1c120c66cb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:12.953098 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:12.953378 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:12.953651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:12.954363 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:12.954666 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:12.956322 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:12.967465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1346/2699] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:12.967666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1354/2700] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:12 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:12.975176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:13.006386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:13.038382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01da1b7-908b-4186-a78a-7989e9e7494b tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:13.043425 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:13.044115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.044395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.044667 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.045390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:13.046976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:13.060663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1347/2701] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:13.062269 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:13.072694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d080052-6868-4447-abc3-6699b7d854be admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:13.074461 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487c34-9982-4674-a0ed-7cc50ce34fa8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:13.077935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:13.078886 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.079258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.079425 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9ca032dd36d49b8910d63a358b16201', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cbe8c2ce7014c8e92401e1c120c66cb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:13.079683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] PATH_INFO: `/v3/projects/55eda55b111f4a23bfadfa078d3e23e5/users/d146533a68174724a138c86c3d88e5c1/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.080585 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.080875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.081334 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] PATH_INFO: `/v3/projects/56b1bd8dc777423abb57692375a9a4c4` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.082523 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56b1bd8dc777423abb57692375a9a4c4)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:13.087853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:13.097034 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eda55b111f4a23bfadfa078d3e23e5, user_id=d146533a68174724a138c86c3d88e5c1, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:13.099786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:13.191417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1348/2702] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:13 2022] PUT /identity/v3/projects/55eda55b111f4a23bfadfa078d3e23e5/users/d146533a68174724a138c86c3d88e5c1/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:13.195095 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:13.237911 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b1bd8dc777423abb57692375a9a4c4', 'request_id': 'req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:13.243887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b1bd8dc777423abb57692375a9a4c4', 'request_id': 'req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:13.268743 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2a4be-6198-4c56-82e3-8f1cdcd26c97 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:13.322286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:13.322941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.323218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.323490 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.324270 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:13.325851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:13.335244 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1349/2703] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:13.339194 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:13.344548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b1bd8dc777423abb57692375a9a4c4', 'request_id': 'req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:13.348375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d947a-63a6-43ab-9fcc-f6d7fc805311 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:13.353259 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:13.354181 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.354461 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.354736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] PATH_INFO: `/v3/projects/55eda55b111f4a23bfadfa078d3e23e5/users/d146533a68174724a138c86c3d88e5c1/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.356151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] The token cache is being invalidate because project 56b1bd8dc777423abb57692375a9a4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:13.356437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:13.356759 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eda55b111f4a23bfadfa078d3e23e5, user_id=d146533a68174724a138c86c3d88e5c1, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:13.357085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-fcd053e2-75af-42c3-a4d9-00cbdb64b87c tempest-VolumeQuotaClassesTest-1816681460 tempest-VolumeQuotaClassesTest-1816681460-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:13.358628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1355/2704] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:13 2022] DELETE /identity/v3/projects/56b1bd8dc777423abb57692375a9a4c4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:13.360467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:13.371949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1350/2705] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:13 2022] PUT /identity/v3/projects/55eda55b111f4a23bfadfa078d3e23e5/users/d146533a68174724a138c86c3d88e5c1/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:13.383875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.384162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.384446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.410673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] MFA Rules not processed for user `d146533a68174724a138c86c3d88e5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:13.411965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:13.478576 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1356/2706] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:13.490585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:13.492418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:13.548312 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dab3f-0d2c-465f-931e-70d005472ad5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:13.552626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:13.553264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:13.553553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:13.553828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:13.555612 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:13.612075 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:13.613513 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a914f-89b6-4576-b9fc-7f22905b8290 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:13.622283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1351/2707] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:14.076954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:14.078361 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:14.146294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c73ef-0b37-4604-be2f-b984469f3efd None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:14.150732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:14.151592 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:14.151906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:14.152183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] PATH_INFO: `/v3/users/5d6571d018634d94b9e45227fd6a0c0b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:14.153366 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d6571d018634d94b9e45227fd6a0c0b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:14.155265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:14.415894 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d6571d018634d94b9e45227fd6a0c0b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:14.494273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d6571d018634d94b9e45227fd6a0c0b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:14.502003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d6571d018634d94b9e45227fd6a0c0b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:14.502727 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d6571d018634d94b9e45227fd6a0c0b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:14.514583 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d6571d018634d94b9e45227fd6a0c0b'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:14.520599 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1357/2708] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:14 2022] DELETE /identity/v3/users/5d6571d018634d94b9e45227fd6a0c0b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:14.525271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:14.525590 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:14.525799 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:14.543969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:14.545166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:14.603368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1352/2709] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:14.613888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:14.615415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:14.672336 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572972ef-e3bb-465b-b0ad-5f4565731977 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:14.675866 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:14.676499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:14.676782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:14.677056 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:14.685933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:14.687349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:14.696935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1358/2710] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:15.136057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:15.137597 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:15.149654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c38bd-95ce-44ef-8aab-d974d443662d None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:15.154959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:15.155117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:15.155368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:15.155797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] PATH_INFO: `/v3/projects/1a2b4abcac5b413ba593a0e548d2f250` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:15.156984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2b4abcac5b413ba593a0e548d2f250)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:15.159518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:15.331329 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2b4abcac5b413ba593a0e548d2f250', 'request_id': 'req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.337057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2b4abcac5b413ba593a0e548d2f250', 'request_id': 'req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.511171 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2b4abcac5b413ba593a0e548d2f250', 'request_id': 'req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.523787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] The token cache is being invalidate because project 1a2b4abcac5b413ba593a0e548d2f250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:15.524077 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.524757 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.526573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1353/2711] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:15 2022] DELETE /identity/v3/projects/1a2b4abcac5b413ba593a0e548d2f250 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:15.530268 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:15.540448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809134f-df11-4c2c-ba9a-8b6f1954d08e service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:15.598258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:15.599132 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:15.599432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:15.599728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] PATH_INFO: `/v3/users/a9ca032dd36d49b8910d63a358b16201` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:15.602199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ca032dd36d49b8910d63a358b16201)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:15.603003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:15.755570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:15.757025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:15.812554 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d1bfc-e69a-44b2-9f3a-a59fe807e58e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:15.816330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:15.816508 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ca032dd36d49b8910d63a358b16201'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.816983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:15.817267 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:15.817543 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:15.819344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:15.880515 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:15.881999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:15.888604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ca032dd36d49b8910d63a358b16201'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.891785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1354/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:15.896777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ca032dd36d49b8910d63a358b16201'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.897654 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ca032dd36d49b8910d63a358b16201'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.909413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:15.910959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:15.911450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-67a8a932-0298-44b7-acc2-6a0862dbe09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ca032dd36d49b8910d63a358b16201'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:15.917888 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1359/2713] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:15 2022] DELETE /identity/v3/users/a9ca032dd36d49b8910d63a358b16201 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:15.926970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1374-b683-4c38-926a-978d1bcc4b40 service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:15.988595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:15.989509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:15.989828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:15.990083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] PATH_INFO: `/v3/users/bc265566130848f19808a608f389c652` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:15.991350 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc265566130848f19808a608f389c652)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:15.993330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:16.256965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc265566130848f19808a608f389c652'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.380132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc265566130848f19808a608f389c652'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.387298 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc265566130848f19808a608f389c652'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.391591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc265566130848f19808a608f389c652'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.391591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc265566130848f19808a608f389c652'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.405394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1355/2714] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:15 2022] DELETE /identity/v3/users/bc265566130848f19808a608f389c652 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:16.409944 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.410237 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.410521 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.420751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:16.422169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:16.432169 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:16.433433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:16.490699 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d6913-0ac1-455d-a0c3-d78b9aa391ae admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:16.494337 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1360/2715] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:16.495496 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:16.496385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.496663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.496934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] PATH_INFO: `/v3/projects/8cbe8c2ce7014c8e92401e1c120c66cb` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.498254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cbe8c2ce7014c8e92401e1c120c66cb)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:16.500179 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:16.505136 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:16.506526 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:16.563316 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2598007-927c-4681-9089-b4d6df9d6248 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:16.567004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75ff3f-a608-4852-867e-1250470a8959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:16.567694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75ff3f-a608-4852-867e-1250470a8959 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.567981 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75ff3f-a608-4852-867e-1250470a8959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.568258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75ff3f-a608-4852-867e-1250470a8959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.577124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75ff3f-a608-4852-867e-1250470a8959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:16.578611 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75ff3f-a608-4852-867e-1250470a8959 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:16.588015 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1361/2716] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:16.620539 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cbe8c2ce7014c8e92401e1c120c66cb', 'request_id': 'req-e1b23367-bddc-4f81-965e-ee0e6443ea48'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.626020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cbe8c2ce7014c8e92401e1c120c66cb', 'request_id': 'req-e1b23367-bddc-4f81-965e-ee0e6443ea48'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.705566 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cbe8c2ce7014c8e92401e1c120c66cb', 'request_id': 'req-e1b23367-bddc-4f81-965e-ee0e6443ea48'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.716813 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] The token cache is being invalidate because project 8cbe8c2ce7014c8e92401e1c120c66cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:16.717545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.717833 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-e1b23367-bddc-4f81-965e-ee0e6443ea48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:16.719402 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1356/2717] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:16 2022] DELETE /identity/v3/projects/8cbe8c2ce7014c8e92401e1c120c66cb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:16.725111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.725394 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.725666 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.743843 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:16.748719 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:16.802160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1362/2718] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:16.810133 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.810661 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.810777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.829706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:16.830955 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:16.839394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1357/2719] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:16.844048 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:16.854689 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef4d7-bf09-4402-8a58-ad1a39012516 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:16.862116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:16.862786 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.863192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.863357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.864161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:16.864471 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:16.866101 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:16.878421 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1363/2720] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:16.884256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:16.893913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a60acc-9754-4ed2-bcdd-b267cb5a5c80 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:16.898869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:16.899525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:16.899870 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:16.900150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:16.900849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:16.902796 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.004209 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1358/2721] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:16 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:17.008085 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.018168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869429bc-6647-4d70-879b-22ba1c860800 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.067415 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.069180 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:17.077871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.078549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.078832 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.079108 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.079848 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.081902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.135431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65f628-e6bf-410f-b64d-88338f79e293 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.140097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.140946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.141225 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.141493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] PATH_INFO: `/v3/projects/3a2ba740c0534d63ae1dbf7eac1f360a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.142665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2ba740c0534d63ae1dbf7eac1f360a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.144751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.174722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1364/2722] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:17 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:17.178357 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.187882 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c98c3-1554-426e-b7b9-68fd6e467b16 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.192455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.193078 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.193362 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.193640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.194359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.196004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.206115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1365/2723] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:17.209075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.218159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dae4a1-f402-45ef-8205-3e6a939a22d3 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.223350 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.223979 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.224266 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.224544 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.225242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.226755 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.240698 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1366/2724] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:17.241858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.251345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa8a7f-874c-4e5a-bbc3-20ccaa316278 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.258440 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9be9f-ace8-40bc-97aa-ed16963921e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.259343 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9be9f-ace8-40bc-97aa-ed16963921e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.259759 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9be9f-ace8-40bc-97aa-ed16963921e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.260205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9be9f-ace8-40bc-97aa-ed16963921e3 admin admin] PATH_INFO: `/v3/projects/bd36d75f2aca459a881ab76f6a7840e5/users/b6cd562c34f94a2abb715b9104f65b64/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.280482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9be9f-ace8-40bc-97aa-ed16963921e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd36d75f2aca459a881ab76f6a7840e5, user_id=b6cd562c34f94a2abb715b9104f65b64, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.283826 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9be9f-ace8-40bc-97aa-ed16963921e3 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.402572 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1367/2725] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:17 2022] PUT /identity/v3/projects/bd36d75f2aca459a881ab76f6a7840e5/users/b6cd562c34f94a2abb715b9104f65b64/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:17.413565 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.413884 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.414222 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.415217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2ba740c0534d63ae1dbf7eac1f360a', 'request_id': 'req-82828044-2047-4d00-a130-c9fb5a99c68e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.420905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2ba740c0534d63ae1dbf7eac1f360a', 'request_id': 'req-82828044-2047-4d00-a130-c9fb5a99c68e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.440017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] MFA Rules not processed for user `b6cd562c34f94a2abb715b9104f65b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:17.441216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:17.503153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1368/2726] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:17.508149 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.517102 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2ba740c0534d63ae1dbf7eac1f360a', 'request_id': 'req-82828044-2047-4d00-a130-c9fb5a99c68e'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.529964 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] The token cache is being invalidate because project 3a2ba740c0534d63ae1dbf7eac1f360a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:17.530510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.531353 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.533233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1359/2727] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:17 2022] DELETE /identity/v3/projects/3a2ba740c0534d63ae1dbf7eac1f360a => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:17.538216 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.539211 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:17.575936 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ba35b-adef-4082-a183-e39926568122 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.581195 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.581852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.582131 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.582402 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.583097 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.585038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.614828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828044-2047-4d00-a130-c9fb5a99c68e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.615634 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.616512 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.616790 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.617062 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] PATH_INFO: `/v3/users/cf435c72e5a348f8bf50c8b3291a7904` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.618229 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf435c72e5a348f8bf50c8b3291a7904)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.620308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.701095 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1369/2728] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:17 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:17.701849 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.703367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:17.757954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdf5f-b392-41d6-9909-c395bcb5902e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.761551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.762172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.762449 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.762721 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.764483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:17.812708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf435c72e5a348f8bf50c8b3291a7904'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.828442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.829871 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.839887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1370/2729] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:17.840649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:17.844935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:17.894395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf435c72e5a348f8bf50c8b3291a7904'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.902142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf435c72e5a348f8bf50c8b3291a7904'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.902818 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf435c72e5a348f8bf50c8b3291a7904'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.903469 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf435c72e5a348f8bf50c8b3291a7904'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:17.909859 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f25a4-d076-4613-a695-fb078370326c service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:17.914437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:17.915115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:17.915397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:17.915718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:17.916403 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:17.918596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:17.920978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1360/2730] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:17 2022] DELETE /identity/v3/users/cf435c72e5a348f8bf50c8b3291a7904 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:18.035263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1371/2731] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:17 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:18.036651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.038114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:18.122802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b9409-91e2-44f9-a2ec-84dd2cfcc62f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.128248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.129012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.129381 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.129725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.130538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.132253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.142635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1361/2732] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:18.146934 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.157349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023f7b6-ab32-4510-808a-ed872b2a7c95 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.162217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.167245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.167245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.167245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] PATH_INFO: `/v3/projects/b9f73ae98f4b465b8160b2c321ca834f/users/f097421a19004098bcc207249fd43e7a/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.180446 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f73ae98f4b465b8160b2c321ca834f, user_id=f097421a19004098bcc207249fd43e7a, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.183187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.283112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1372/2733] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:18 2022] PUT /identity/v3/projects/b9f73ae98f4b465b8160b2c321ca834f/users/f097421a19004098bcc207249fd43e7a/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:18.287041 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.297349 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0528df-a457-4e2a-aecf-579c645fd84b admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.353750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf71c6d-e7f9-4500-98c7-b99ad3d26cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.354409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf71c6d-e7f9-4500-98c7-b99ad3d26cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.354691 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf71c6d-e7f9-4500-98c7-b99ad3d26cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.354969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf71c6d-e7f9-4500-98c7-b99ad3d26cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.355740 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf71c6d-e7f9-4500-98c7-b99ad3d26cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.357371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf71c6d-e7f9-4500-98c7-b99ad3d26cbe admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.367487 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1362/2734] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:18.371566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.382067 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4ae0-1d9c-44ea-828a-182d488b5d4e admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.386863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.387740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.391003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.391003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] PATH_INFO: `/v3/projects/b9f73ae98f4b465b8160b2c321ca834f/users/f097421a19004098bcc207249fd43e7a/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.391003 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f73ae98f4b465b8160b2c321ca834f, user_id=f097421a19004098bcc207249fd43e7a, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.392931 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.403255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1373/2735] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:18 2022] PUT /identity/v3/projects/b9f73ae98f4b465b8160b2c321ca834f/users/f097421a19004098bcc207249fd43e7a/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:18.413973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.417617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.417617 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.443990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] MFA Rules not processed for user `f097421a19004098bcc207249fd43e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:18.446344 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:18.513023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1363/2736] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:18.524005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.525812 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:18.582833 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e415dd-131d-4b20-9ae0-75c5f3cc695b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.586429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.587064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.587349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.587657 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.597129 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.598553 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.608011 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1374/2737] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:18.639433 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.644690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:18.656375 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.657764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:18.670036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05361f9-34db-4880-8330-ce5a1589141f service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.673852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.675053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.675333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.675661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.677442 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:18.716109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e78c-b6c1-4327-aa33-faa1f73caa52 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.720786 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.722173 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:18.722454 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:18.722729 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] PATH_INFO: `/v3/projects/72807a6d94444a8ebd18dd2f546415fc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:18.723968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72807a6d94444a8ebd18dd2f546415fc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.725885 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.736389 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:18.738427 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:18.747549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1375/2738] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:18.831665 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72807a6d94444a8ebd18dd2f546415fc', 'request_id': 'req-174026db-5c0d-4cae-98c3-abd0678a6656'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:18.837074 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72807a6d94444a8ebd18dd2f546415fc', 'request_id': 'req-174026db-5c0d-4cae-98c3-abd0678a6656'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:18.905432 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72807a6d94444a8ebd18dd2f546415fc', 'request_id': 'req-174026db-5c0d-4cae-98c3-abd0678a6656'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:18.917704 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] The token cache is being invalidate because project 72807a6d94444a8ebd18dd2f546415fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:18.917995 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:18.918631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:18.920226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1364/2739] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:18 2022] DELETE /identity/v3/projects/72807a6d94444a8ebd18dd2f546415fc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:18.924206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:18.935125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993724-30ed-4b42-b400-f122fa07d50a service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:18.994757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:18.995648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:19.002086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:19.002086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] PATH_INFO: `/v3/users/90dbd12d6a264f6eb25308241b01f7a6` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:19.002086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90dbd12d6a264f6eb25308241b01f7a6)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:19.002086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:19.237649 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90dbd12d6a264f6eb25308241b01f7a6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:19.346275 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90dbd12d6a264f6eb25308241b01f7a6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:19.353989 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90dbd12d6a264f6eb25308241b01f7a6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:19.354661 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90dbd12d6a264f6eb25308241b01f7a6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:19.366100 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-dfba9293-6b89-459d-ad8e-8e7060b43b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90dbd12d6a264f6eb25308241b01f7a6'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:19.372299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1376/2740] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:18 2022] DELETE /identity/v3/users/90dbd12d6a264f6eb25308241b01f7a6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:19.809045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:19.810485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:19.823978 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174026db-5c0d-4cae-98c3-abd0678a6656 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:19.882177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:19.883040 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:19.883320 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:19.883591 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] PATH_INFO: `/v3/projects/a890954c8dcb43c3adee0a0454892ff2` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:19.884803 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a890954c8dcb43c3adee0a0454892ff2)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:19.886716 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.025240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a890954c8dcb43c3adee0a0454892ff2', 'request_id': 'req-5cbb5002-ab9e-4127-bc22-1f8941972ffa'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:20.030409 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a890954c8dcb43c3adee0a0454892ff2', 'request_id': 'req-5cbb5002-ab9e-4127-bc22-1f8941972ffa'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:20.122981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a890954c8dcb43c3adee0a0454892ff2', 'request_id': 'req-5cbb5002-ab9e-4127-bc22-1f8941972ffa'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:20.134559 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] The token cache is being invalidate because project a890954c8dcb43c3adee0a0454892ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:20.134849 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:20.135473 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-5cbb5002-ab9e-4127-bc22-1f8941972ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:20.137033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1365/2741] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:19 2022] DELETE /identity/v3/projects/a890954c8dcb43c3adee0a0454892ff2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:20.141980 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.142465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.142564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.161089 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:20.162273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:20.219792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1377/2742] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:20.228245 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.228535 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.228811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.247195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:20.248406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:20.256204 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1366/2743] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:20.260299 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.270273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ac1b5-95b6-494f-b002-ddc05df08da2 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.274817 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.275500 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.275853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.276153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.276939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:20.277245 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.278820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.290862 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1378/2744] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:20.296443 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.304718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf3ea6-09a2-40da-802a-b9347b939837 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.309368 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.310007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.310283 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.310552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.311261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.313183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.425873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1367/2745] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:20 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:20.429897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.439738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813d7d7-3c10-4331-b887-b4f53e319578 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.496493 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.497182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.497458 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.497730 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.498401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.500376 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.603399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1379/2746] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:20 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:20.607477 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.617644 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c3dfc-35e7-4fec-92a6-9c413addb113 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.622261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.622911 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.623192 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.623493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.624331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.625949 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.636967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1368/2747] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:20.646260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.656134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e23780-4c5e-48cb-8f84-06779b41bbf4 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.661489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb2a3-ab13-4f4d-a2c4-f4220ad9eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.666503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb2a3-ab13-4f4d-a2c4-f4220ad9eb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.666503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb2a3-ab13-4f4d-a2c4-f4220ad9eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.666503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb2a3-ab13-4f4d-a2c4-f4220ad9eb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.666503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb2a3-ab13-4f4d-a2c4-f4220ad9eb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.666503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb2a3-ab13-4f4d-a2c4-f4220ad9eb6d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.675148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1380/2748] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:20.679403 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.689493 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11e02-3bc9-47f0-b9ba-c28baf600485 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.695220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.695651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.695965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.696243 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] PATH_INFO: `/v3/projects/54ab55ea74bb47e0a24ca827cea18908/users/89efdf39a23449e9930e9a3c44c72f49/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.710924 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab55ea74bb47e0a24ca827cea18908, user_id=89efdf39a23449e9930e9a3c44c72f49, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.713615 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:20.790375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1369/2749] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:20 2022] PUT /identity/v3/projects/54ab55ea74bb47e0a24ca827cea18908/users/89efdf39a23449e9930e9a3c44c72f49/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:20.795684 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9acb9-165e-4531-848e-c52df6775c4a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.795975 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9acb9-165e-4531-848e-c52df6775c4a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.796250 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9acb9-165e-4531-848e-c52df6775c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.815094 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-2be9acb9-165e-4531-848e-c52df6775c4a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:20.816355 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-2be9acb9-165e-4531-848e-c52df6775c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:20.887017 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1381/2750] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:20.897254 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:20.899110 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:20.962632 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fac5e-3cf1-43a0-a120-1bdb71edde56 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:20.967715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:20.968359 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:20.968637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:20.968906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:20.980900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:20.982374 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:21.002795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1370/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:22.513021 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:22.513522 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:22.513635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:22.542182 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] MFA Rules not processed for user `89efdf39a23449e9930e9a3c44c72f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:22.543477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:22.612212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1382/2752] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:22.623293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:22.625279 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:22.685754 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db74205-e160-4a48-a712-43e02e6fd579 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:22.690429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2a83b-916a-445e-b880-87dde52ec998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:22.690941 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:22.691083 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a83b-916a-445e-b880-87dde52ec998 service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:22.691365 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a83b-916a-445e-b880-87dde52ec998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:22.691676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2a83b-916a-445e-b880-87dde52ec998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:22.692359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:22.700533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2a83b-916a-445e-b880-87dde52ec998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:22.701965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2a83b-916a-445e-b880-87dde52ec998 service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:22.705696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c38197-b7aa-4f17-b20b-c812a2615d07 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:22.710503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:22.711093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1371/2753] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:22.711432 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:22.711761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:22.712144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] PATH_INFO: `/v3/users/d9146573871b48d0a5196f279ca8cca3` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:22.713422 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9146573871b48d0a5196f279ca8cca3)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:22.715482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:22.923448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9146573871b48d0a5196f279ca8cca3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.020030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9146573871b48d0a5196f279ca8cca3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.027397 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9146573871b48d0a5196f279ca8cca3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.028039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9146573871b48d0a5196f279ca8cca3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.039845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9146573871b48d0a5196f279ca8cca3'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.045922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1383/2754] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:22 2022] DELETE /identity/v3/users/d9146573871b48d0a5196f279ca8cca3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:23.051053 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:23.051347 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:23.051858 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:23.068306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:23.069492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:23.128364 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1372/2755] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:23.138256 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:23.139760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:23.197073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a46739-8685-4f42-9e35-f919ca9d29e7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:23.200699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:23.201328 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:23.201606 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:23.201917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:23.210718 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:23.212258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:23.222935 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1384/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:23.713865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:23.715435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:23.732722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d847d1-380c-452e-a638-1d7c5639254f None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:23.739925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:23.740395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:23.740653 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:23.740969 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] PATH_INFO: `/v3/projects/f785efb80b62468999c3a8f6336df95e` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:23.742183 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f785efb80b62468999c3a8f6336df95e)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:23.744154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:23.832033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f785efb80b62468999c3a8f6336df95e', 'request_id': 'req-6f31a917-5a47-4487-8ca1-cc7f9a71af21'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.837538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f785efb80b62468999c3a8f6336df95e', 'request_id': 'req-6f31a917-5a47-4487-8ca1-cc7f9a71af21'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.905371 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f785efb80b62468999c3a8f6336df95e', 'request_id': 'req-6f31a917-5a47-4487-8ca1-cc7f9a71af21'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.916586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] The token cache is being invalidate because project f785efb80b62468999c3a8f6336df95e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:23.916868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.917768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:23.919296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1373/2757] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:23 2022] DELETE /identity/v3/projects/f785efb80b62468999c3a8f6336df95e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:23.923313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:23.936916 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81db954-8fc1-4db9-aba9-2a519987bc2c service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:23.992781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:23.994529 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:24.000777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:24.001646 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:24.001927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:24.002869 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] PATH_INFO: `/v3/users/58030a4660a54f6f9c23aa5bf33b0efc` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:24.004105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58030a4660a54f6f9c23aa5bf33b0efc)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:24.006678 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:24.056199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a917-5a47-4487-8ca1-cc7f9a71af21 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:24.060777 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:24.061631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:24.061912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:24.062187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] PATH_INFO: `/v3/users/b6cd562c34f94a2abb715b9104f65b64` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:24.063360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6cd562c34f94a2abb715b9104f65b64)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:24.065889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:24.302578 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58030a4660a54f6f9c23aa5bf33b0efc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.381499 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6cd562c34f94a2abb715b9104f65b64'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.402758 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58030a4660a54f6f9c23aa5bf33b0efc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.410865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58030a4660a54f6f9c23aa5bf33b0efc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.411524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58030a4660a54f6f9c23aa5bf33b0efc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.423212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-9a8e66ac-89f6-408e-a1c6-cc6283b367e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58030a4660a54f6f9c23aa5bf33b0efc'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.429958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1385/2758] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:23 2022] DELETE /identity/v3/users/58030a4660a54f6f9c23aa5bf33b0efc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:24.488749 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6cd562c34f94a2abb715b9104f65b64'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.496370 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6cd562c34f94a2abb715b9104f65b64'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.497250 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6cd562c34f94a2abb715b9104f65b64'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.497834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6cd562c34f94a2abb715b9104f65b64'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:24.514838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1374/2759] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:23 2022] DELETE /identity/v3/users/b6cd562c34f94a2abb715b9104f65b64 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:24.519691 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f863da-1e95-4e59-ba30-7c97d3fad145 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:24.520030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f863da-1e95-4e59-ba30-7c97d3fad145 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:24.520306 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f863da-1e95-4e59-ba30-7c97d3fad145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:24.537715 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-48f863da-1e95-4e59-ba30-7c97d3fad145 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:24.538897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-48f863da-1e95-4e59-ba30-7c97d3fad145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:24.596739 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1386/2760] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:24.614048 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:24.615500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:24.692347 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:24.692722 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:24.693009 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:24.696242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7280e-332d-4dc0-9fcd-87af7806df5d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:24.700220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:24.700927 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:24.701212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:24.701486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:24.710736 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] MFA Rules not processed for user `89efdf39a23449e9930e9a3c44c72f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:24.710992 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:24.711954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:24.712467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:24.723256 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1375/2761] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:24.769777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1387/2762] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:24.844872 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:24.847431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:24.861507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58114-8bf6-406b-8b79-9150973a547f service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:24.866467 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:24.867346 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:24.867656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:24.867939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] PATH_INFO: `/v3/projects/d1745e140dbf4882ab21521a904b7bac` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:24.869136 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1745e140dbf4882ab21521a904b7bac)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:24.871161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:25.010109 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1745e140dbf4882ab21521a904b7bac', 'request_id': 'req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.015802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1745e140dbf4882ab21521a904b7bac', 'request_id': 'req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.059753 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:25.069386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48b61a-1a50-4218-b1f1-830229a88a52 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:25.099829 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1745e140dbf4882ab21521a904b7bac', 'request_id': 'req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.112451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] The token cache is being invalidate because project d1745e140dbf4882ab21521a904b7bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:25.112750 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.113531 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.115361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1376/2763] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:24 2022] DELETE /identity/v3/projects/d1745e140dbf4882ab21521a904b7bac => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:25.119262 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:25.120626 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:25.124655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:25.125591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:25.126134 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:25.126428 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:25.129435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:25.140156 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:25.141625 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:25.151380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1388/2764] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:57:25.202166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c1e25-0422-4eab-a8ba-e9478dac0a09 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:25.208066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:25.208950 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:25.209221 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:25.209491 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] PATH_INFO: `/v3/users/d146533a68174724a138c86c3d88e5c1` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:25.210730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d146533a68174724a138c86c3d88e5c1)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:25.212694 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:25.330900 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:25.332367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:25.352710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0818a-990c-471d-81e0-cdc24bea6691 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:25.358710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:25.359147 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:25.359226 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:25.359868 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] PATH_INFO: `/v3/projects/bd36d75f2aca459a881ab76f6a7840e5` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:25.361566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd36d75f2aca459a881ab76f6a7840e5)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:25.363242 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:25.399854 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd146533a68174724a138c86c3d88e5c1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.471356 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd146533a68174724a138c86c3d88e5c1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.478868 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd146533a68174724a138c86c3d88e5c1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.479565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd146533a68174724a138c86c3d88e5c1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.480212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd146533a68174724a138c86c3d88e5c1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.488837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd36d75f2aca459a881ab76f6a7840e5', 'request_id': 'req-5cf85974-d9b7-492e-b5d1-3efa91beb446'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.494360 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd36d75f2aca459a881ab76f6a7840e5', 'request_id': 'req-5cf85974-d9b7-492e-b5d1-3efa91beb446'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.497603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1377/2765] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:25 2022] DELETE /identity/v3/users/d146533a68174724a138c86c3d88e5c1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:25.631168 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd36d75f2aca459a881ab76f6a7840e5', 'request_id': 'req-5cf85974-d9b7-492e-b5d1-3efa91beb446'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.642613 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] The token cache is being invalidate because project bd36d75f2aca459a881ab76f6a7840e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:25.642897 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.643529 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.645225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1389/2766] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:25 2022] DELETE /identity/v3/projects/bd36d75f2aca459a881ab76f6a7840e5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:25.649226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:25.650640 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:25.716722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fa3ec-d58e-4daf-9592-d3062fcbeed6 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:25.721475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:25.722351 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:25.722635 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:25.722913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] PATH_INFO: `/v3/users/f097421a19004098bcc207249fd43e7a` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:25.724134 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f097421a19004098bcc207249fd43e7a)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:25.726069 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:25.940115 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f097421a19004098bcc207249fd43e7a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:25.993921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:25.995395 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:26.019846 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f097421a19004098bcc207249fd43e7a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.027906 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f097421a19004098bcc207249fd43e7a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.029224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f097421a19004098bcc207249fd43e7a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.030028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-ba4a1caa-deb6-4a04-ab52-0e750ab41795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f097421a19004098bcc207249fd43e7a'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.050638 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1378/2767] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:25 2022] DELETE /identity/v3/users/f097421a19004098bcc207249fd43e7a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:26.064469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85974-d9b7-492e-b5d1-3efa91beb446 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:26.120313 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:26.121179 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.121464 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.121743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] PATH_INFO: `/v3/projects/55eda55b111f4a23bfadfa078d3e23e5` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.122966 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55eda55b111f4a23bfadfa078d3e23e5)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:26.124938 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:26.302825 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55eda55b111f4a23bfadfa078d3e23e5', 'request_id': 'req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.309037 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55eda55b111f4a23bfadfa078d3e23e5', 'request_id': 'req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.494208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55eda55b111f4a23bfadfa078d3e23e5', 'request_id': 'req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.510111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] The token cache is being invalidate because project 55eda55b111f4a23bfadfa078d3e23e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:26.510111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.510111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.510111 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1390/2768] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:25 2022] DELETE /identity/v3/projects/55eda55b111f4a23bfadfa078d3e23e5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:26.513567 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335c67-2b4c-49d1-9e7d-e7fc5041d3a3 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.513853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335c67-2b4c-49d1-9e7d-e7fc5041d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.514130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09335c67-2b4c-49d1-9e7d-e7fc5041d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.532866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-09335c67-2b4c-49d1-9e7d-e7fc5041d3a3 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:26.534859 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-09335c67-2b4c-49d1-9e7d-e7fc5041d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:26.564696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:26.567481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:26.598054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1379/2769] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:26.609164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.609504 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.609788 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.633060 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:26.634324 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:26.640564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea57c1-6ebb-4eeb-88ec-c33ceccf9433 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:26.643572 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1380/2770] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:26.647775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:26.649369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:26.649896 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.650176 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.650451 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] PATH_INFO: `/v3/projects/b9f73ae98f4b465b8160b2c321ca834f` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.651708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f73ae98f4b465b8160b2c321ca834f)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:26.654452 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:26.657199 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aae919-4b9d-49e4-a4ba-cd3ee8216a37 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:26.662507 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:26.665483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.665483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.665483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.665483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:26.665483 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:26.666306 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:26.679428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1381/2771] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:26.683690 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:26.697945 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0098a9a-ca43-4c4d-a526-f3437802a201 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:26.702767 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:26.703417 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.703737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.704017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.704711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:26.707414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:26.751231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f73ae98f4b465b8160b2c321ca834f', 'request_id': 'req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.757070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f73ae98f4b465b8160b2c321ca834f', 'request_id': 'req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.833656 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1382/2772] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:26 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:26.837592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:26.848608 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f73ae98f4b465b8160b2c321ca834f', 'request_id': 'req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.860939 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] The token cache is being invalidate because project b9f73ae98f4b465b8160b2c321ca834f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:26.861233 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.861909 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-62c4d12a-08a9-4c4a-a1e2-f96b2c1129da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:26.863482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1391/2773] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:26 2022] DELETE /identity/v3/projects/b9f73ae98f4b465b8160b2c321ca834f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:26.868692 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef206-cd4b-41f6-bb7f-9f4664c5b557 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.868982 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef206-cd4b-41f6-bb7f-9f4664c5b557 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.869257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef206-cd4b-41f6-bb7f-9f4664c5b557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.888704 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-348ef206-cd4b-41f6-bb7f-9f4664c5b557 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:26.890496 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-348ef206-cd4b-41f6-bb7f-9f4664c5b557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:26.902561 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe082e-84b5-4118-97cd-7392d94a250f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:26.907195 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:26.907898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.908708 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.909000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.909687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:26.911647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:26.949183 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1392/2774] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:26.958473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:26.958765 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:26.959054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:26.977512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:26.978728 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:26.986757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1393/2775] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:26.990820 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.000032 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca1171-107d-464f-bd5a-bbe8afc93c7c None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.005263 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.005907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.006219 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.006540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.007253 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:27.007563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.009181 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.014404 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1383/2776] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:26 2022] POST /identity/v3/users => generated 282 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:27.017073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.019293 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:27.024764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1394/2777] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:27.025690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.031314 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71afdc-d997-4ce7-90aa-f30ea6e69800 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.035115 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4476b-2d56-431b-81e0-2b140ee4d80d admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.036093 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.036683 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.036966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.037237 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.037952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.039528 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.040274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.040927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.041212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.041499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.042477 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.044383 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.050820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1384/2778] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:27.057288 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.069159 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4573c-7d91-41d9-a478-fc19bf4ddddd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.074003 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.074685 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.074960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.075264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.076028 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.077639 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.089190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1385/2779] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:27.093051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.102201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64f600-900a-4e56-8507-0fe41e29a4b8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.106946 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12807abd-2374-44c3-831d-4428885c8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.107828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807abd-2374-44c3-831d-4428885c8cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.108087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807abd-2374-44c3-831d-4428885c8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.108354 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12807abd-2374-44c3-831d-4428885c8cc0 admin admin] PATH_INFO: `/v3/projects/7d2b5014cee24ef09160fee9e73ec763/users/1031d225c694417fbaa8c72f9c08f9be/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.122971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12807abd-2374-44c3-831d-4428885c8cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2b5014cee24ef09160fee9e73ec763, user_id=1031d225c694417fbaa8c72f9c08f9be, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.125631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12807abd-2374-44c3-831d-4428885c8cc0 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.151205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1395/2780] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:27 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:27.155447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.218227 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4141a18-a61d-4316-8c83-1be889c2599a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.223234 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.223926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.224208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.224482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.225163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.227143 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.275673 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1386/2781] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:27 2022] PUT /identity/v3/projects/7d2b5014cee24ef09160fee9e73ec763/users/1031d225c694417fbaa8c72f9c08f9be/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:57:27.288445 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.288735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.289067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.317188 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] MFA Rules not processed for user `1031d225c694417fbaa8c72f9c08f9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:27.318388 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:27.380852 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1387/2782] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:27 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:27.391655 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1396/2783] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:27 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:27.393071 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.394360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:27.395594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.405324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801879-0b08-4159-b9b1-473365f9ccdb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.452517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047768f-8425-4681-8bf2-f08a0506ecb5 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.456804 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.457449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.457726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.457997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.461286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.461958 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.462243 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.462520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.464548 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.464867 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.468806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.470285 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.478332 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1397/2784] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:27.479373 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.483449 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1388/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:27.489996 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ec449-2b6e-44ea-b435-c4afcd234874 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.494701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2e766-c0fa-47b2-92e5-e6e6c1216837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.495400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e766-c0fa-47b2-92e5-e6e6c1216837 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.495709 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e766-c0fa-47b2-92e5-e6e6c1216837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.495984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2e766-c0fa-47b2-92e5-e6e6c1216837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.496749 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2e766-c0fa-47b2-92e5-e6e6c1216837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.498430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2e766-c0fa-47b2-92e5-e6e6c1216837 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.508708 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1398/2786] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 03 22:57:27.512787 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.523315 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1ae44-9f37-4edd-b34f-90aa0500ac9b service cinder] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.527842 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.528706 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.528983 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.529248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] PATH_INFO: `/v3/projects/6b5238b5c3ff4dceb05a49d4e45b12e0/users/c3d904981d2f4e95aa924f7466e2d162/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.547097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5238b5c3ff4dceb05a49d4e45b12e0, user_id=c3d904981d2f4e95aa924f7466e2d162, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.550720 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.614682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1389/2787] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:27 2022] PUT /identity/v3/projects/6b5238b5c3ff4dceb05a49d4e45b12e0/users/c3d904981d2f4e95aa924f7466e2d162/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:27.625025 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.625294 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.625581 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.651189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] MFA Rules not processed for user `c3d904981d2f4e95aa924f7466e2d162`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:27.652409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:27.716119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1399/2788] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:27.727435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:27.729230 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:27.812263 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7e1b2-4132-4d54-8199-10b302f926ce admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:27.815853 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285393ef-09ff-4f3c-bae2-182ea10cf15e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:27.816594 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285393ef-09ff-4f3c-bae2-182ea10cf15e service cinder] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:27.816875 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285393ef-09ff-4f3c-bae2-182ea10cf15e service cinder] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:27.817142 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285393ef-09ff-4f3c-bae2-182ea10cf15e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:27.826063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285393ef-09ff-4f3c-bae2-182ea10cf15e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:27.827478 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285393ef-09ff-4f3c-bae2-182ea10cf15e service cinder] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:27.837002 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1390/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:38.092075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:38.151899 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc8bc-3ec0-4483-b5a8-218a8dfd8585 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:38.156518 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:38.157374 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:38.157652 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:38.157927 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] PATH_INFO: `/v3/users/c3d904981d2f4e95aa924f7466e2d162` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:38.159102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d904981d2f4e95aa924f7466e2d162)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:38.161597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:38.398076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d904981d2f4e95aa924f7466e2d162'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:38.482163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d904981d2f4e95aa924f7466e2d162'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:38.489845 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d904981d2f4e95aa924f7466e2d162'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:38.493285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d904981d2f4e95aa924f7466e2d162'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:38.502255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d904981d2f4e95aa924f7466e2d162'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:38.508628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1400/2790] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:57:38 2022] DELETE /identity/v3/users/c3d904981d2f4e95aa924f7466e2d162 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:38.513094 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:38.513598 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:38.513703 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:38.530410 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:38.531715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:38.589020 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1391/2791] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:38.600433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:38.601836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:38.658481 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789f920-f9bc-413b-ae67-237745a8002c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:38.662545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd89473-e8ce-4c56-9d86-3e0e2bc11ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:38.663174 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd89473-e8ce-4c56-9d86-3e0e2bc11ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:38.663454 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd89473-e8ce-4c56-9d86-3e0e2bc11ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:38.663763 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd89473-e8ce-4c56-9d86-3e0e2bc11ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:38.673004 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd89473-e8ce-4c56-9d86-3e0e2bc11ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:38.674429 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd89473-e8ce-4c56-9d86-3e0e2bc11ccb service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:38.684469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1401/2792] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:57:39.073675 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.075277 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:39.087816 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b4c40-34d9-40a4-9222-b8c5645c0295 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.093939 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.095375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.095375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.095375 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] PATH_INFO: `/v3/projects/6b5238b5c3ff4dceb05a49d4e45b12e0` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.096571 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5238b5c3ff4dceb05a49d4e45b12e0)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.098498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:39.247837 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5238b5c3ff4dceb05a49d4e45b12e0', 'request_id': 'req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:39.253887 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5238b5c3ff4dceb05a49d4e45b12e0', 'request_id': 'req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:39.340249 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5238b5c3ff4dceb05a49d4e45b12e0', 'request_id': 'req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:39.361620 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] The token cache is being invalidate because project 6b5238b5c3ff4dceb05a49d4e45b12e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:57:39.362037 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:39.362731 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-07d09ac3-0a0f-49b3-a8b3-cbfa1c288b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:57:39.367806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1392/2793] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:57:39 2022] DELETE /identity/v3/projects/6b5238b5c3ff4dceb05a49d4e45b12e0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:39.370251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.371284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.371767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.406801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:39.406801 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:39.472413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1402/2794] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:39.480929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.482848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.482848 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.501751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:39.503042 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:39.512428 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1393/2795] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:57:39.519837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.529901 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba931e-06e1-4913-ba6a-8e9d75ac6b85 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.534682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.535910 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.536209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.536482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.537204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:57:39.537510 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.539209 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:39.552063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1403/2796] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:57:39.556439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.565446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d596b-22d6-4718-a363-13f2c1bf6e45 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.571521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.571521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.571521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.571521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.572114 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.574032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:39.655839 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1394/2797] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:57:39 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:57:39.660019 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.670520 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c8a1c-f38e-42b7-adf8-6317ad353102 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.725186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.725848 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.726130 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.726412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.727107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.729055 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:39.808114 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1404/2798] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:57:39 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:57:39.812129 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.822915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e811-13b3-47b7-9d40-6c5ff04fc416 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.827623 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.828278 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.828558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.828834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.829558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.831148 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:39.841801 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1395/2799] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:39.845853 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.856460 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5562a7-03f6-4d87-93aa-e5b23d8bdbbc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.861109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef6dda-748f-44d6-9b14-c7613a7e645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.861750 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef6dda-748f-44d6-9b14-c7613a7e645d admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.862029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef6dda-748f-44d6-9b14-c7613a7e645d admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.862345 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef6dda-748f-44d6-9b14-c7613a7e645d admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.863064 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef6dda-748f-44d6-9b14-c7613a7e645d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.864702 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef6dda-748f-44d6-9b14-c7613a7e645d admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:39.874304 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1405/2800] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:57:39.878441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:39.888414 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e044-4bce-4e33-ad4f-6b21605a71fa admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:39.893023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:39.893912 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:39.894190 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:39.895017 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] PATH_INFO: `/v3/projects/6873104841fb49ef82932952bcd16095/users/7cfa66cbdbc7467bad3f5b8ccd2441da/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:39.909465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6873104841fb49ef82932952bcd16095, user_id=7cfa66cbdbc7467bad3f5b8ccd2441da, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:39.912781 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:40.003297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1396/2801] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:57:39 2022] PUT /identity/v3/projects/6873104841fb49ef82932952bcd16095/users/7cfa66cbdbc7467bad3f5b8ccd2441da/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:57:40.079285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:40.079630 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:40.079917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:40.106631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] MFA Rules not processed for user `7cfa66cbdbc7467bad3f5b8ccd2441da`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:57:40.108024 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:40.169353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1406/2802] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:57:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:57:40.180450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:57:40.182107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:57:40.237933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b65565-54ac-445a-872b-bd6460d2b540 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:57:40.241565 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b8cd5-20b1-4583-bd1d-2601354ac262 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bffce7ed1d0d4606914bc071da22801a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:57:40.242196 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b8cd5-20b1-4583-bd1d-2601354ac262 service glance] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:57:40.242475 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b8cd5-20b1-4583-bd1d-2601354ac262 service glance] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:57:40.242746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b8cd5-20b1-4583-bd1d-2601354ac262 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:57:40.251228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b8cd5-20b1-4583-bd1d-2601354ac262 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:57:40.252717 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b8cd5-20b1-4583-bd1d-2601354ac262 service glance] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:57:40.261882 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1397/2803] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:57:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:58:22.929202 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:22.930682 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:22.994512 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328ed6a-383a-4e03-8b5f-07b3f20e53e7 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:22.999090 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:23.008906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:23.008906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:23.008906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] PATH_INFO: `/v3/users/1031d225c694417fbaa8c72f9c08f9be` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:23.008906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1031d225c694417fbaa8c72f9c08f9be)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:23.008906 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:23.247876 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1031d225c694417fbaa8c72f9c08f9be'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:23.308914 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1031d225c694417fbaa8c72f9c08f9be'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:23.318386 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1031d225c694417fbaa8c72f9c08f9be'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:23.321161 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1031d225c694417fbaa8c72f9c08f9be'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:23.334092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1031d225c694417fbaa8c72f9c08f9be'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:23.340273 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1407/2804] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:58:22 2022] DELETE /identity/v3/users/1031d225c694417fbaa8c72f9c08f9be => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:23.344647 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:23.346073 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:23.346962 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:23.366007 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:23.367272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:23.425907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1398/2805] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:23.435902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:23.437315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:23.493443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c53b9-4e63-44ba-90b5-8b1e64140564 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:23.497198 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fde92-baf3-4d2a-95ff-4314d266740a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:23.497841 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fde92-baf3-4d2a-95ff-4314d266740a service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:23.498125 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fde92-baf3-4d2a-95ff-4314d266740a service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:23.498426 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fde92-baf3-4d2a-95ff-4314d266740a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:23.510239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fde92-baf3-4d2a-95ff-4314d266740a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:23.510239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fde92-baf3-4d2a-95ff-4314d266740a service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:23.520577 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1408/2806] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:58:23.889967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:23.891457 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:23.904297 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a57d-2ed6-4a7d-9d5d-18a4612ba04b None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:23.910197 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:23.911154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:23.911439 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:23.911746 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] PATH_INFO: `/v3/projects/7d2b5014cee24ef09160fee9e73ec763` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:23.912966 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2b5014cee24ef09160fee9e73ec763)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:23.914925 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.024066 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2b5014cee24ef09160fee9e73ec763', 'request_id': 'req-71b7c1b1-148f-4cb6-8d30-f448593ab67f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.030252 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2b5014cee24ef09160fee9e73ec763', 'request_id': 'req-71b7c1b1-148f-4cb6-8d30-f448593ab67f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.091435 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2b5014cee24ef09160fee9e73ec763', 'request_id': 'req-71b7c1b1-148f-4cb6-8d30-f448593ab67f'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.102603 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] The token cache is being invalidate because project 7d2b5014cee24ef09160fee9e73ec763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:58:24.102893 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.103510 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-71b7c1b1-148f-4cb6-8d30-f448593ab67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.105087 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1399/2807] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:58:23 2022] DELETE /identity/v3/projects/7d2b5014cee24ef09160fee9e73ec763 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:24.109972 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.110448 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.110552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.128469 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:24.130228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:24.186582 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1409/2808] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:24.194726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.195013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.195295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.213965 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:24.216418 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:24.226319 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1400/2809] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:24.230540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.240552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841ea32-58e0-41f5-8b76-08691bc07ca9 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.245049 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.245688 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.245967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.246239 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.247033 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:58:24.247338 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.248963 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.260619 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1410/2810] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 22:58:24.264788 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.273736 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991c478-ac6b-4d08-be63-1e369f781045 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.278311 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.278942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.279223 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.279497 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.280215 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.282100 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.372520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1401/2811] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:58:24 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:58:24.376714 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.386597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51017a62-ceb7-4540-b55f-fad8dc90182a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.441296 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.442013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.442295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.442569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.443248 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.445199 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.516189 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1411/2812] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:58:24 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:58:24.520340 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.530570 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29446dcd-a609-4d0f-aeea-f2bcd7ff54f8 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.535253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.536821 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.537242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.537651 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.538687 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.540336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.551905 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1402/2813] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:58:24.555780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.565837 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdb825-b1d1-443b-b12c-623389cc7a3f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.570424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.571070 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.571369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.571710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.572431 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.574008 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.584836 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1412/2814] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:58:24.588201 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.588550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.590047 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:24.598628 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9ed19-77e2-4c83-94e2-8f7b6cb027a6 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.602915 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcfe26-4111-4483-9aff-8f171100a122 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.603231 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8da02-4aa0-443a-a97a-5561299de39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.604123 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8da02-4aa0-443a-a97a-5561299de39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.604400 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8da02-4aa0-443a-a97a-5561299de39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.604673 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8da02-4aa0-443a-a97a-5561299de39c admin admin] PATH_INFO: `/v3/projects/d67649ce9c7c4de3b50d20295d421629/users/401d7a8ce5fe46b1a83aa1f2584714fc/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.607495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.608401 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.608680 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.608988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] PATH_INFO: `/v3/users/7cfa66cbdbc7467bad3f5b8ccd2441da` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.610157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cfa66cbdbc7467bad3f5b8ccd2441da)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.612157 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.621575 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8da02-4aa0-443a-a97a-5561299de39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67649ce9c7c4de3b50d20295d421629, user_id=401d7a8ce5fe46b1a83aa1f2584714fc, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.624217 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8da02-4aa0-443a-a97a-5561299de39c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.705262 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1413/2815] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:58:24 2022] PUT /identity/v3/projects/d67649ce9c7c4de3b50d20295d421629/users/401d7a8ce5fe46b1a83aa1f2584714fc/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:58:24.713790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.714086 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.714396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.731165 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:24.732396 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:24.788377 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1414/2816] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:58:24.797132 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cfa66cbdbc7467bad3f5b8ccd2441da'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.798102 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.799568 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:24.854731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add143a-cc00-47da-8f2d-89243b1fa444 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:24.858367 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d2de4-505c-41e7-b608-e3b7c10151db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:24.859000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cfa66cbdbc7467bad3f5b8ccd2441da'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.859116 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d2de4-505c-41e7-b608-e3b7c10151db service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.859283 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d2de4-505c-41e7-b608-e3b7c10151db service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.859559 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d2de4-505c-41e7-b608-e3b7c10151db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.866187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cfa66cbdbc7467bad3f5b8ccd2441da'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.869321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cfa66cbdbc7467bad3f5b8ccd2441da'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.869321 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cfa66cbdbc7467bad3f5b8ccd2441da'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:24.869552 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d2de4-505c-41e7-b608-e3b7c10151db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:24.869976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d2de4-505c-41e7-b608-e3b7c10151db service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:24.879324 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1415/2817] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:58:24.886305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1403/2818] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:58:24 2022] DELETE /identity/v3/users/7cfa66cbdbc7467bad3f5b8ccd2441da => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:58:24.890570 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:24.892392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:24.892392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:24.908887 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:24.910083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:24.968414 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1416/2819] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 22:58:24.979013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:24.980446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:25.038616 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d004851-9255-456c-8fd2-1549beea73df admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:25.042654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d6df6-0651-45e7-ba0c-7b78d63cfd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:25.043654 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d6df6-0651-45e7-ba0c-7b78d63cfd18 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:25.044043 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d6df6-0651-45e7-ba0c-7b78d63cfd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:25.044412 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d6df6-0651-45e7-ba0c-7b78d63cfd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:25.053836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d6df6-0651-45e7-ba0c-7b78d63cfd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:25.055271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d6df6-0651-45e7-ba0c-7b78d63cfd18 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:25.064696 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1404/2820] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:58:25.552998 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:25.555436 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:25.569509 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc3738-a2f3-428b-a21f-d8870f69102a None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:25.574016 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:25.575065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:25.575640 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:25.575767 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] PATH_INFO: `/v3/projects/6873104841fb49ef82932952bcd16095` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:25.577188 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6873104841fb49ef82932952bcd16095)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:25.579178 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:25.726976 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6873104841fb49ef82932952bcd16095', 'request_id': 'req-3f92efbb-46c6-4e95-b055-484b928f9bab'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:25.732216 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6873104841fb49ef82932952bcd16095', 'request_id': 'req-3f92efbb-46c6-4e95-b055-484b928f9bab'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:25.813413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6873104841fb49ef82932952bcd16095', 'request_id': 'req-3f92efbb-46c6-4e95-b055-484b928f9bab'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:25.829965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] The token cache is being invalidate because project 6873104841fb49ef82932952bcd16095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:58:25.829965 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:25.830551 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-3f92efbb-46c6-4e95-b055-484b928f9bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:25.832164 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1417/2821] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:58:25 2022] DELETE /identity/v3/projects/6873104841fb49ef82932952bcd16095 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:25.837709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:25.838186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:25.838308 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:25.856434 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:25.857631 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:25.914756 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1405/2822] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:25.922992 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:25.923285 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:25.923569 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:25.941399 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:25.943110 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:25.950947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1418/2823] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:25.959360 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:25.969150 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610184a-e1eb-4739-92c6-86cc08923743 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:25.974633 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:25.975301 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:25.975583 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:25.975897 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:25.977000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 22:58:25.977000 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:25.978542 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:25.991498 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1406/2824] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 22:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 03 22:58:25.995683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:26.008054 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8d2b0-8381-48b7-8521-57d663bf65c8 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:26.012779 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:26.013430 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.013738 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.014012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.014740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:26.016872 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:26.123921 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1419/2825] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:58:25 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:58:26.128162 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:26.138748 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe6f95-9a77-4a5c-b3d9-633460800b91 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:26.211012 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:26.211718 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.212005 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.212284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.213025 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:26.214953 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:26.299797 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1407/2826] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:58:26 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:58:26.304450 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:26.314530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4871e-78ce-42b8-a779-a6aa52d52b4c admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:26.319984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:26.320651 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.320932 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.321207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.321930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:26.323524 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:26.335083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1420/2827] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:58:26.338898 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:26.349538 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045040de-3d1c-474d-8b3e-04740e98b66d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:26.354624 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130338c2-66ea-4f5e-9c2f-83bc0f0ab6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:26.355280 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130338c2-66ea-4f5e-9c2f-83bc0f0ab6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.355562 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130338c2-66ea-4f5e-9c2f-83bc0f0ab6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.355866 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130338c2-66ea-4f5e-9c2f-83bc0f0ab6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.356726 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130338c2-66ea-4f5e-9c2f-83bc0f0ab6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:26.358336 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130338c2-66ea-4f5e-9c2f-83bc0f0ab6f8 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:26.370460 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1408/2828] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:58:26.374435 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:26.385511 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4821b8e-17b7-4bd5-820c-c70f1506d497 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:26.390381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:26.391323 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.391700 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.392036 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] PATH_INFO: `/v3/projects/4c1e62ddbdfb4279aea4c92eec3e4108/users/403524d699de4e9ea2f0a1b5531302d1/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.406777 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1e62ddbdfb4279aea4c92eec3e4108, user_id=403524d699de4e9ea2f0a1b5531302d1, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:26.409519 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:26.514945 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1421/2829] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:58:26 2022] PUT /identity/v3/projects/4c1e62ddbdfb4279aea4c92eec3e4108/users/403524d699de4e9ea2f0a1b5531302d1/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:26.526395 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c70ce9-8eea-468f-9b3c-c932b31a5678 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.526733 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c70ce9-8eea-468f-9b3c-c932b31a5678 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.527045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c70ce9-8eea-468f-9b3c-c932b31a5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.558768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-d7c70ce9-8eea-468f-9b3c-c932b31a5678 None None] MFA Rules not processed for user `403524d699de4e9ea2f0a1b5531302d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:26.560217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d7c70ce9-8eea-468f-9b3c-c932b31a5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:26.637228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1409/2830] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:26.648232 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:26.649967 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:26.710208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6450-bfbd-4b45-ba0e-8f5d6a515700 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:26.713984 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:26.714643 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:26.714926 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:26.715206 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:26.734672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:26.736937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:26.749775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1422/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:58:30.338429 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:30.338952 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:30.339218 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:30.366990 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] MFA Rules not processed for user `401d7a8ce5fe46b1a83aa1f2584714fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:30.368295 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:30.434169 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1410/2832] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:30.438667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:30.440696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:30.506594 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7195d-2f8c-4115-91d2-727a130954b4 service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:30.511478 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:30.512197 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:30.512483 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:30.512764 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:30.513484 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:30.515437 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:30.655792 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1423/2833] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 22:58:30 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 22:58:30.657226 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:30.668629 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa3695-c5e6-4cde-8e96-7a84639d1db9 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:30.725970 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:30.726648 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:30.726933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:30.727208 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] PATH_INFO: `/v3/users` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:30.727937 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:30.729988 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:30.812253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1411/2834] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 22:58:30 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 22:58:30.816305 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:30.827159 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87125f8c-85a7-4d0e-804e-b6a6978e5a2a admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:30.831573 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:30.832770 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:30.833051 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:30.833320 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:30.834040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:30.835676 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:30.845905 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1424/2835] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:58:30.850697 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:30.860682 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa36508-5569-47ca-bfb5-236487f8bc44 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:30.865302 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:30.866172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:30.866451 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:30.866722 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] PATH_INFO: `/v3/projects/bcb5428d0f88461c85bb4240a19b6f45/users/46f4e280c81443a69c4734ec04db0aa7/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:30.880931 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5428d0f88461c85bb4240a19b6f45, user_id=46f4e280c81443a69c4734ec04db0aa7, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:30.883569 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:30.954577 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1412/2836] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:58:30 2022] PUT /identity/v3/projects/bcb5428d0f88461c85bb4240a19b6f45/users/46f4e280c81443a69c4734ec04db0aa7/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 22:58:30.959062 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:30.969109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de70ae-333e-46e1-a154-56faa86bc27f admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:31.027118 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d469a85-6ab6-4453-b4fe-f7008268c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:31.027870 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469a85-6ab6-4453-b4fe-f7008268c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:31.028152 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469a85-6ab6-4453-b4fe-f7008268c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:31.028433 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d469a85-6ab6-4453-b4fe-f7008268c2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:31.029144 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469a85-6ab6-4453-b4fe-f7008268c2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:31.030725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d469a85-6ab6-4453-b4fe-f7008268c2c7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:31.040545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1425/2837] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 22:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 22:58:31.044968 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:31.054894 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972c30-fb59-40d6-81d2-6cc6249746dd admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:31.059431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:31.060355 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:31.060636 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:31.060909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] PATH_INFO: `/v3/projects/bcb5428d0f88461c85bb4240a19b6f45/users/46f4e280c81443a69c4734ec04db0aa7/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:31.062851 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb5428d0f88461c85bb4240a19b6f45, user_id=46f4e280c81443a69c4734ec04db0aa7, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:31.065558 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:31.076275 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1413/2838] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 22:58:31 2022] PUT /identity/v3/projects/bcb5428d0f88461c85bb4240a19b6f45/users/46f4e280c81443a69c4734ec04db0aa7/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:36.712482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:36.713010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:36.713438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:36.744873 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] MFA Rules not processed for user `46f4e280c81443a69c4734ec04db0aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:36.746119 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:36.827782 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1426/2839] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:36.837525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:36.839253 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:36.915130 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d071502-48ee-4ac1-a963-175c6b1eedf6 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:36.921024 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:36.921684 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:36.921967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:36.922240 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:36.999981 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:37.002220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:37.016692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1414/2840] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:58:39.021012 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:39.024088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:39.136371 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fefcb-93fc-448e-adc6-f73ecc7f0f73 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:39.141517 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:39.142251 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:39.142532 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:39.142808 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:39.144667 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:39.157381 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:39.159171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dafc18-7678-4603-aa0c-ab7aedc50d13 service placement] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:39.170196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1427/2841] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:58:49.076881 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:49.138284 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b5066-7781-45e8-81f1-121cbe8538c3 service nova] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:49.143023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:49.143929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:49.144217 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:49.144492 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] PATH_INFO: `/v3/users/403524d699de4e9ea2f0a1b5531302d1` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:49.145676 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=403524d699de4e9ea2f0a1b5531302d1)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:49.147618 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:49.325330 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403524d699de4e9ea2f0a1b5531302d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:49.390692 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403524d699de4e9ea2f0a1b5531302d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:49.398909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403524d699de4e9ea2f0a1b5531302d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:49.399751 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403524d699de4e9ea2f0a1b5531302d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:49.401780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403524d699de4e9ea2f0a1b5531302d1'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:49.419967 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1415/2842] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 22:58:49 2022] DELETE /identity/v3/users/403524d699de4e9ea2f0a1b5531302d1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:49.430597 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:49.431058 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:49.431163 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:49.449293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:49.450539 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:49.508211 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1428/2843] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:58:49.517943 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:49.519385 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:49.575934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdced2f-6395-4982-aa95-bd073d3e20f5 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:49.579391 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563957fb-127b-4b7d-8385-78889e5e9857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:49.580057 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563957fb-127b-4b7d-8385-78889e5e9857 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:49.580338 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563957fb-127b-4b7d-8385-78889e5e9857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:49.580609 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563957fb-127b-4b7d-8385-78889e5e9857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:49.590331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563957fb-127b-4b7d-8385-78889e5e9857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:49.591836 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563957fb-127b-4b7d-8385-78889e5e9857 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:49.601971 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1416/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 22:58:50.232105 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:58:50.233530 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:50.246349 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aec002-e74f-49cf-8872-4765c0352610 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:58:50.253790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:58:50.255297 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:50.255593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:50.256177 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] PATH_INFO: `/v3/projects/4c1e62ddbdfb4279aea4c92eec3e4108` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:50.257634 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1e62ddbdfb4279aea4c92eec3e4108)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:58:50.259540 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:58:50.391732 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1e62ddbdfb4279aea4c92eec3e4108', 'request_id': 'req-41367be1-fbce-4919-b3ab-1570eb404a51'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:50.397053 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1e62ddbdfb4279aea4c92eec3e4108', 'request_id': 'req-41367be1-fbce-4919-b3ab-1570eb404a51'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:50.463039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1e62ddbdfb4279aea4c92eec3e4108', 'request_id': 'req-41367be1-fbce-4919-b3ab-1570eb404a51'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:50.474315 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] The token cache is being invalidate because project 4c1e62ddbdfb4279aea4c92eec3e4108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 22:58:50.474603 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:50.478545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-41367be1-fbce-4919-b3ab-1570eb404a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 22:58:50.478545 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1429/2845] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 22:58:50 2022] DELETE /identity/v3/projects/4c1e62ddbdfb4279aea4c92eec3e4108 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 22:58:58.879869 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:58:58.880465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:58:58.880465 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:58:58.897737 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] MFA Rules not processed for user `89efdf39a23449e9930e9a3c44c72f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:58:58.898928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:58:58.951526 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1417/2846] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:58:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:59:01.014259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:59:01.014761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:59:01.014864 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:59:01.032415 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] MFA Rules not processed for user `401d7a8ce5fe46b1a83aa1f2584714fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 22:59:01.033595 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:59:01.085369 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1430/2847] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 22:59:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 22:59:19.699914 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:59:19.701341 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:59:19.759785 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be033d-99c4-4c4e-b45b-cdd0e30a70db None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:59:19.763963 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:59:19.764228 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:59:19.764573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:59:19.764768 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:59:19.766533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:59:19.828372 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:59:19.829826 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:59:19.839271 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1418/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:59:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:59:38.590208 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:59:38.591632 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:59:38.647717 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34871ca7-7682-41ad-8d30-e9732f0208f4 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:59:38.651192 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec2e18cb1804b6f94d646491f8c20c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:59:38.651846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:59:38.652128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:59:38.652401 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:59:38.654113 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:59:38.720902 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:59:38.722380 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:59:38.733092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1431/2849] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:59:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 22:59:41.585637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 22:59:41.594055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ab1cb-2e38-40a9-8f3a-3044c86a4b3b service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 22:59:41.597637 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 22:59:41.598264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 22:59:41.598545 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 22:59:41.598820 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 22:59:41.600573 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 22:59:41.613481 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 22:59:41.615406 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 22:59:41.626085 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1419/2850] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 22:59:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:00:08.986974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:08.988443 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:09.053005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323de60f-fd19-4057-89ce-2ca111239fff service cinder] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:09.057558 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:09.058409 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:09.058683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:09.058957 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] PATH_INFO: `/v3/users/89efdf39a23449e9930e9a3c44c72f49` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:09.060172 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89efdf39a23449e9930e9a3c44c72f49)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:09.062076 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:09.391803 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89efdf39a23449e9930e9a3c44c72f49'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.458241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89efdf39a23449e9930e9a3c44c72f49'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.465571 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89efdf39a23449e9930e9a3c44c72f49'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.466196 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89efdf39a23449e9930e9a3c44c72f49'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.477499 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-b1ebbef5-51d0-43ea-ba15-2c508cd03e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89efdf39a23449e9930e9a3c44c72f49'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.483223 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1432/2851] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 23:00:08 2022] DELETE /identity/v3/users/89efdf39a23449e9930e9a3c44c72f49 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:00:09.731780 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:09.743789 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291a4d1-a6f1-43fa-8f82-f9184c4040a9 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:09.799282 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:09.800187 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:09.800476 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:09.800752 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] PATH_INFO: `/v3/projects/54ab55ea74bb47e0a24ca827cea18908` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:09.801951 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ab55ea74bb47e0a24ca827cea18908)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:09.803941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:09.899873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ab55ea74bb47e0a24ca827cea18908', 'request_id': 'req-98b77d55-e34e-4be7-a440-8e9829df6cf9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.905158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ab55ea74bb47e0a24ca827cea18908', 'request_id': 'req-98b77d55-e34e-4be7-a440-8e9829df6cf9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.987144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ab55ea74bb47e0a24ca827cea18908', 'request_id': 'req-98b77d55-e34e-4be7-a440-8e9829df6cf9'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.998431 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] The token cache is being invalidate because project 54ab55ea74bb47e0a24ca827cea18908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 23:00:09.998922 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:09.999753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-98b77d55-e34e-4be7-a440-8e9829df6cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:00:10.002383 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1420/2852] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 23:00:09 2022] DELETE /identity/v3/projects/54ab55ea74bb47e0a24ca827cea18908 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:00:10.011307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.011846 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.012075 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.032775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:00:10.033990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:10.090865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1433/2853] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 23:00:10.098873 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.099164 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.099442 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.117855 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:00:10.119055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:10.126933 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1421/2854] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 23:00:10.131190 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.140775 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37fc04-4dad-4c4f-9a49-08983159588f None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.145286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.145918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.146200 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.146473 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.147187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 03 23:00:10.147489 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.149621 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.161088 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1434/2855] 10.222.0.23 () {58 vars in 1152 bytes} [Tue May 3 23:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 03 23:00:10.165867 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.175146 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5645d6-8b91-4e10-a537-18fd1f733e00 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.179819 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.180459 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.180741 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.181015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.181705 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.183595 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.270888 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1422/2856] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 23:00:10 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 23:00:10.275293 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.285264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee602090-0719-4a22-bbf6-6fe10e00f739 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.340083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.340734 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.341010 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.341279 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.341949 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.343852 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.423990 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1435/2857] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 23:00:10 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 23:00:10.428178 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.438393 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d61ccd-6b50-4c2a-8dee-5a369b11d36e admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.443081 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.443770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.444052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.444325 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.445051 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.447186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.457348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1423/2858] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 23:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 23:00:10.461933 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.471455 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91392c0a-6c97-473e-886a-2323b7bf9f18 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.476013 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f1cea-4861-411c-a42d-a3e8197c53ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.476694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f1cea-4861-411c-a42d-a3e8197c53ed admin admin] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.476954 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f1cea-4861-411c-a42d-a3e8197c53ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.477228 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f1cea-4861-411c-a42d-a3e8197c53ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.477943 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f1cea-4861-411c-a42d-a3e8197c53ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.479881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f1cea-4861-411c-a42d-a3e8197c53ed admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.489388 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1436/2859] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 23:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 23:00:10.493304 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.503158 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f5f64-8903-4236-915d-a82e7c08511f admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.507712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.509086 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.509413 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.509689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] PATH_INFO: `/v3/projects/c4603134505e4a49bc7abbb0b4a1fce6/users/7c6178f935c64e41974e81aa4e908656/roles/d283c28c6467425d80d17a4b6dda137b` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.523642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4603134505e4a49bc7abbb0b4a1fce6, user_id=7c6178f935c64e41974e81aa4e908656, role_id=d283c28c6467425d80d17a4b6dda137b)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.526861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.593258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1424/2860] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 23:00:10 2022] PUT /identity/v3/projects/c4603134505e4a49bc7abbb0b4a1fce6/users/7c6178f935c64e41974e81aa4e908656/roles/d283c28c6467425d80d17a4b6dda137b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:00:10.598319 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4401f-5508-4afd-acc4-6437013e164f None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.598610 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4401f-5508-4afd-acc4-6437013e164f None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.598886 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4401f-5508-4afd-acc4-6437013e164f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.616162 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-8aa4401f-5508-4afd-acc4-6437013e164f None None] MFA Rules not processed for user `a29ada27094d4702b47eeff209b1d340`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:00:10.617353 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-8aa4401f-5508-4afd-acc4-6437013e164f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:10.673536 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1437/2861] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 23:00:10.683795 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:10.685485 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:10.740437 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd056e-af51-471a-b46d-20019eaf93e7 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:10.744614 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:10.745251 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:10.745534 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:10.745811 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:10.754592 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:10.756063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:10.765834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1425/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:00:15.957046 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:15.957564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:15.957564 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:15.989264 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] MFA Rules not processed for user `7c6178f935c64e41974e81aa4e908656`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:00:15.990806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:16.072065 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1438/2863] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:00:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 23:00:16.076117 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:16.087033 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6607a-e73b-489f-9f09-b1b6942a7dc7 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:16.096358 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:16.097166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:16.097551 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:16.098032 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] PATH_INFO: `/v3/projects` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:16.098976 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:16.101172 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:16.204514 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1426/2864] 10.222.0.23 () {60 vars in 1152 bytes} [Tue May 3 23:00:16 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 03 23:00:16.208858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:16.223858 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71605875-429e-4ca1-b3ba-2d9c3dcbbb43 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:16.302486 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:16.303563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:16.304069 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:16.304648 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] PATH_INFO: `/v3/users` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:16.306274 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:16.309644 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:16.417636 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1439/2865] 10.222.0.23 () {60 vars in 1143 bytes} [Tue May 3 23:00:16 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 03 23:00:16.420730 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:16.431394 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02457ebf-da68-4ed2-b56e-7dc2abc6313d admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:16.436015 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:16.436663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:16.436941 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:16.437214 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:16.437938 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:16.439517 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:16.450175 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1427/2866] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 23:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 23:00:16.454151 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:16.463865 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595472e1-2220-454b-ba25-c8e664a877db admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:16.468307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:16.469171 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:16.469453 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:16.469725 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] PATH_INFO: `/v3/projects/26c1f2b21438445182a233b22b03ab63/users/77a816a2befa4d81b708af83aedc8090/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:16.484762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c1f2b21438445182a233b22b03ab63, user_id=77a816a2befa4d81b708af83aedc8090, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:16.487419 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:16.585148 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1440/2867] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 23:00:16 2022] PUT /identity/v3/projects/26c1f2b21438445182a233b22b03ab63/users/77a816a2befa4d81b708af83aedc8090/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 23:00:16.589348 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:16.599144 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92d6f5-a2e2-4a95-8d61-2a5e25374fef admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:16.653396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1d299-bacd-48f6-8a1b-eb862c063ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:16.654054 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1d299-bacd-48f6-8a1b-eb862c063ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:16.654334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1d299-bacd-48f6-8a1b-eb862c063ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:16.654606 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1d299-bacd-48f6-8a1b-eb862c063ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:16.655334 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1d299-bacd-48f6-8a1b-eb862c063ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:16.656956 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1d299-bacd-48f6-8a1b-eb862c063ba4 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:16.666766 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1428/2868] 10.222.0.23 () {58 vars in 1121 bytes} [Tue May 3 23:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 03 23:00:16.671492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:16.682393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fea7a-0b6c-4c3e-93ba-76919b9bf8cc admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:16.687005 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:16.687922 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] REQUEST_METHOD: `PUT` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:16.688327 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:16.688605 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] PATH_INFO: `/v3/projects/26c1f2b21438445182a233b22b03ab63/users/77a816a2befa4d81b708af83aedc8090/roles/4c81f00224c04152b175b99a19a7b21c` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:16.690683 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c1f2b21438445182a233b22b03ab63, user_id=77a816a2befa4d81b708af83aedc8090, role_id=4c81f00224c04152b175b99a19a7b21c)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:16.693447 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:16.705212 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1441/2869] 10.222.0.23 () {60 vars in 1482 bytes} [Tue May 3 23:00:16 2022] PUT /identity/v3/projects/26c1f2b21438445182a233b22b03ab63/users/77a816a2befa4d81b708af83aedc8090/roles/4c81f00224c04152b175b99a19a7b21c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:00:22.081913 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458baa94-811d-4253-a30e-1da145ab176f None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:22.083834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458baa94-811d-4253-a30e-1da145ab176f None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:22.083834 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458baa94-811d-4253-a30e-1da145ab176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:22.112714 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-458baa94-811d-4253-a30e-1da145ab176f None None] MFA Rules not processed for user `77a816a2befa4d81b708af83aedc8090`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:00:22.113901 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-458baa94-811d-4253-a30e-1da145ab176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:22.192045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1429/2870] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:00:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 03 23:00:22.202806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:22.207378 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:22.285241 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94ac64-6ed9-4c6b-9dc9-bc6bf812985b admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:22.292340 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:22.292999 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:22.293284 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:22.293563 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:22.358761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:22.358761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:22.366186 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1442/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:00:25.057593 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:25.058104 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:25.058205 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:25.075865 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] MFA Rules not processed for user `7c6178f935c64e41974e81aa4e908656`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:00:25.077067 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:25.084182 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1430/2872] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:00:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 23:00:41.520063 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:41.521488 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:41.590930 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242c674-a2ff-4057-837b-1a8943118ba5 service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:41.595851 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:41.596482 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:41.596761 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:41.597030 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:41.598751 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:41.609743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:41.611309 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:41.620985 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1443/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:00:44.740261 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:44.741823 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:44.798248 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4c137-1bb3-411c-99d0-d741527f2fea None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:44.801806 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:44.802446 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:44.807775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:44.807775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:44.807775 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:44.815137 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:44.816642 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:44.825305 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1431/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:00:45.821787 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:45.835207 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfe478-142b-43b5-8a6e-93e7636251dc service placement] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:45.841092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:45.842057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:45.842057 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:45.842307 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:45.845252 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:45.860514 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:45.862121 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:45.876098 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1444/2875] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 23:00:55.628709 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:55.641734 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74104276-fe3c-4cc8-bb5c-5538b3c0f0a6 service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:55.647186 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:55.647928 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:55.648212 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:55.648486 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:55.650233 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:00:55.662622 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:55.664220 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba151bb-30a2-4da9-8d19-fbac3f1e1258 service nova] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:55.675525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1432/2876] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:00:57.890312 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:00:57.909917 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53a98f-30dc-40f9-8dbe-c5b9081bb397 service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:00:57.913527 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:00:57.914155 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:00:57.914438 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:00:57.914713 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:00:57.943410 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:00:57.944863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:00:57.954039 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1445/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:00:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:01:23.979585 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] REQUEST_METHOD: `POST` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:01:23.980055 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:01:23.980161 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:01:24.007272 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.auth.core [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] MFA Rules not processed for user `401d7a8ce5fe46b1a83aa1f2584714fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:01:24.008484 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:01:24.060224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1433/2878] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:01:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 23:01:44.709723 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:01:44.723359 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1d5b0-2034-4518-9cb1-f39c6694604a service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:01:44.729992 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:01:44.730731 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:01:44.731080 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:01:44.731424 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:01:44.733463 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:01:44.758109 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:01:44.759733 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:01:44.771631 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1446/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:01:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:03:09.398576 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:03:09.417438 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683d698-9907-4e89-bb07-268d608f81d6 None None] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:03:09.420999 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:03:09.421960 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:09.422509 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:09.422784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:09.424553 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:09.446111 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:03:09.447518 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:03:09.456045 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1434/2880] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:03:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:03:09.709947 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:03:09.719549 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc7307-2e2c-4a84-b8c9-3b9f7fe6645c service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:03:09.723133 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:03:09.723806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:09.724092 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:09.724365 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:09.726128 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:09.736276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:03:09.737696 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30964c47-4ba2-44d2-b175-1cc733c78997 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:03:09.745784 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1447/2881] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:03:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 23:03:10.851479 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:03:10.859959 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d97d0-fa52-4b65-b406-11f19e5fe3cb service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:03:10.863586 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:03:10.864242 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:10.864520 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:10.864791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:10.866525 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:10.899889 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:03:10.901331 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:03:10.921440 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1435/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:03:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:03:21.577029 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] REQUEST_METHOD: `POST` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:21.577550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:21.577550 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:21.594501 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.auth.core [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] MFA Rules not processed for user `401d7a8ce5fe46b1a83aa1f2584714fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 03 23:03:21.595699 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:21.602904 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1448/2883] 10.222.0.23 () {58 vars in 957 bytes} [Tue May 3 23:03:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 03 23:03:21.905929 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:03:21.915206 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078c90f-b650-4acb-919f-5de39a5c160d service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:03:21.918788 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:03:21.919411 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:21.919725 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:21.919998 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:21.921702 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:21.930993 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:03:21.932427 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:03:21.940068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1436/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:03:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:03:36.512154 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:03:36.524525 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6a486-f672-4784-9ec1-6b1223e14f94 None None] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:03:36.529925 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0846a688aa48a9a69fcb730dc5d7f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:03:36.530557 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:36.530834 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:36.531107 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:36.532863 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:36.543566 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:03:36.545187 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:03:36.554918 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1449/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:03:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:03:43.377552 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:03:43.398828 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3902c2-fb86-4b00-a1a7-ecd2ac4c7cac service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:03:43.403861 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:03:43.404495 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:03:43.404784 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:03:43.405063 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:03:43.406807 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:03:43.430533 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:03:43.432139 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:03:43.441907 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1437/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:03:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:04:47.060790 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:04:47.070541 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33b777-47a9-4bf0-a334-1203e9ee717a service nova] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:04:47.074265 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:04:47.075040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:04:47.075392 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:04:47.075780 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:04:47.078160 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:04:47.091672 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:04:47.093743 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:04:47.105040 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1450/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 03 23:04:48.275791 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:04:48.285224 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263f966-8151-41d7-85c1-0ea3b98251ee service placement] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:04:48.288824 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:04:48.289455 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:04:48.289735 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:04:48.290010 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:04:48.291770 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:04:48.305264 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:04:48.306621 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:04:48.318068 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1438/2888] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:04:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:04:58.471742 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:04:58.550412 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367d6bd-0be6-4d8b-83ad-7ea516878b7b service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:04:58.555038 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:04:58.555952 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:04:58.556295 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:04:58.561591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] PATH_INFO: `/v3/users/7c6178f935c64e41974e81aa4e908656` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:04:58.561591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6178f935c64e41974e81aa4e908656)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:04:58.561591 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:04:58.737258 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6178f935c64e41974e81aa4e908656'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:58.821112 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6178f935c64e41974e81aa4e908656'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:58.828124 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6178f935c64e41974e81aa4e908656'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:58.828760 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6178f935c64e41974e81aa4e908656'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:58.840333 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6178f935c64e41974e81aa4e908656'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:58.846596 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1451/2889] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 23:04:58 2022] DELETE /identity/v3/users/7c6178f935c64e41974e81aa4e908656 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:04:59.104021 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:04:59.117013 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919029ff-e612-4085-94ce-a839bcc78fdd service neutron] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:04:59.177247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:04:59.180521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:04:59.180521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:04:59.180521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] PATH_INFO: `/v3/projects/c4603134505e4a49bc7abbb0b4a1fce6` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:04:59.180521 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4603134505e4a49bc7abbb0b4a1fce6)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:04:59.181711 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:04:59.284744 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4603134505e4a49bc7abbb0b4a1fce6', 'request_id': 'req-40389983-2341-4e5d-82cf-dd1b0681fbd2'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.289984 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4603134505e4a49bc7abbb0b4a1fce6', 'request_id': 'req-40389983-2341-4e5d-82cf-dd1b0681fbd2'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.376628 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4603134505e4a49bc7abbb0b4a1fce6', 'request_id': 'req-40389983-2341-4e5d-82cf-dd1b0681fbd2'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.400044 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] The token cache is being invalidate because project c4603134505e4a49bc7abbb0b4a1fce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 23:04:59.400328 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.400935 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.402453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1439/2890] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 23:04:59 2022] DELETE /identity/v3/projects/c4603134505e4a49bc7abbb0b4a1fce6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:04:59.406562 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:04:59.408122 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:04:59.423286 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dbbe2-6d1a-4942-83a1-550060a1d5e8 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:04:59.479259 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:04:59.480257 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:04:59.480534 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:04:59.480806 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] PATH_INFO: `/v3/users/77a816a2befa4d81b708af83aedc8090` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:04:59.481974 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a816a2befa4d81b708af83aedc8090)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:04:59.483983 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:04:59.676492 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a816a2befa4d81b708af83aedc8090'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.748740 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a816a2befa4d81b708af83aedc8090'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.756393 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a816a2befa4d81b708af83aedc8090'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.757034 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a816a2befa4d81b708af83aedc8090'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.768503 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a816a2befa4d81b708af83aedc8090'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:04:59.774289 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1452/2891] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 23:04:59 2022] DELETE /identity/v3/users/77a816a2befa4d81b708af83aedc8090 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:05:00.012689 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:05:00.014167 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:05:00.030154 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40389983-2341-4e5d-82cf-dd1b0681fbd2 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:05:00.085247 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:05:00.086107 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:05:00.086390 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:05:00.086663 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] PATH_INFO: `/v3/projects/26c1f2b21438445182a233b22b03ab63` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:05:00.087876 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c1f2b21438445182a233b22b03ab63)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:05:00.089753 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:05:00.192396 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c1f2b21438445182a233b22b03ab63', 'request_id': 'req-527accca-2ea8-4f88-97c3-858c62ddf50c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:00.197537 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c1f2b21438445182a233b22b03ab63', 'request_id': 'req-527accca-2ea8-4f88-97c3-858c62ddf50c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:00.268296 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c1f2b21438445182a233b22b03ab63', 'request_id': 'req-527accca-2ea8-4f88-97c3-858c62ddf50c'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:00.279106 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] The token cache is being invalidate because project 26c1f2b21438445182a233b22b03ab63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 23:05:00.279934 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:00.280568 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:00.282097 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1440/2892] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 23:05:00 2022] DELETE /identity/v3/projects/26c1f2b21438445182a233b22b03ab63 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:05:22.458907 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:05:22.460326 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:05:22.514880 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026af85-55a4-411f-a43e-dc57bbf93dbb admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:05:22.560690 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '843f6ae9b5864f00bfea0ea2ab02d552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:05:22.561346 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] REQUEST_METHOD: `GET` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:05:22.561635 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:05:22.561913 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:05:22.563694 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:05:22.622298 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:05:22.623756 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:05:22.632978 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1453/2893] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 03 23:05:30.063480 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:05:30.064997 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:05:30.079450 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527accca-2ea8-4f88-97c3-858c62ddf50c admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:05:30.085286 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:05:30.086177 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:05:30.086458 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:05:30.086732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] PATH_INFO: `/v3/users/401d7a8ce5fe46b1a83aa1f2584714fc` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:05:30.087942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=401d7a8ce5fe46b1a83aa1f2584714fc)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:05:30.089884 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:05:30.309258 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401d7a8ce5fe46b1a83aa1f2584714fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.381973 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401d7a8ce5fe46b1a83aa1f2584714fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.388802 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401d7a8ce5fe46b1a83aa1f2584714fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.389453 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401d7a8ce5fe46b1a83aa1f2584714fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.390052 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401d7a8ce5fe46b1a83aa1f2584714fc'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.407019 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1441/2894] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 23:05:30 2022] DELETE /identity/v3/users/401d7a8ce5fe46b1a83aa1f2584714fc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 03 23:05:30.652668 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:05:30.662276 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad6bf4-3e85-4d24-842c-4d56cee34896 service neutron] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:05:30.722073 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:05:30.722929 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:05:30.723213 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:05:30.723490 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] PATH_INFO: `/v3/projects/d67649ce9c7c4de3b50d20295d421629` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:05:30.724701 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67649ce9c7c4de3b50d20295d421629)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:05:30.726604 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:05:30.832238 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67649ce9c7c4de3b50d20295d421629', 'request_id': 'req-5b913428-b0c9-421b-aed2-fda125fb14a7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.837423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67649ce9c7c4de3b50d20295d421629', 'request_id': 'req-5b913428-b0c9-421b-aed2-fda125fb14a7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.942593 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67649ce9c7c4de3b50d20295d421629', 'request_id': 'req-5b913428-b0c9-421b-aed2-fda125fb14a7'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.953710 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] The token cache is being invalidate because project d67649ce9c7c4de3b50d20295d421629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 23:05:30.953994 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.954662 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:30.956225 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1454/2895] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 23:05:30 2022] DELETE /identity/v3/projects/d67649ce9c7c4de3b50d20295d421629 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:05:30.960732 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:05:30.962176 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:05:30.976165 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f417502-ac29-4782-9942-1b8edfe940d9 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:05:31.037307 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:05:31.038166 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:05:31.038441 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:05:31.038713 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] PATH_INFO: `/v3/users/46f4e280c81443a69c4734ec04db0aa7` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:05:31.039900 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f4e280c81443a69c4734ec04db0aa7)` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:05:31.042124 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:05:31.235268 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f4e280c81443a69c4734ec04db0aa7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.319456 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f4e280c81443a69c4734ec04db0aa7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.326712 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f4e280c81443a69c4734ec04db0aa7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.327361 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f4e280c81443a69c4734ec04db0aa7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.327942 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.notifications [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f4e280c81443a69c4734ec04db0aa7'} {{(pid=80276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.344838 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1442/2896] 10.222.0.23 () {58 vars in 1223 bytes} [Tue May 3 23:05:30 2022] DELETE /identity/v3/users/46f4e280c81443a69c4734ec04db0aa7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:05:31.590205 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Authenticating user token {{(pid=80275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:05:31.591757 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.fernet_utils [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:05:31.605260 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b913428-b0c9-421b-aed2-fda125fb14a7 admin admin] Validating token access rules against request {{(pid=80275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:05:31.663928 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a29ada27094d4702b47eeff209b1d340', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '479aaf8f5b564abd915b2557f4bef485', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:05:31.664875 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:05:31.665153 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:05:31.665465 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] PATH_INFO: `/v3/projects/bcb5428d0f88461c85bb4240a19b6f45` {{(pid=80275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:05:31.666762 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb5428d0f88461c85bb4240a19b6f45)` {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:05:31.668937 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] RBAC: Authorization granted {{(pid=80275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:05:31.771083 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb5428d0f88461c85bb4240a19b6f45', 'request_id': 'req-7ae7939f-9bdd-4eca-a536-369fd8908c23'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.776423 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb5428d0f88461c85bb4240a19b6f45', 'request_id': 'req-7ae7939f-9bdd-4eca-a536-369fd8908c23'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.856204 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb5428d0f88461c85bb4240a19b6f45', 'request_id': 'req-7ae7939f-9bdd-4eca-a536-369fd8908c23'} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.867971 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] The token cache is being invalidate because project bcb5428d0f88461c85bb4240a19b6f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 03 23:05:31.868255 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.868881 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: DEBUG keystone.notifications [None req-7ae7939f-9bdd-4eca-a536-369fd8908c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 03 23:05:31.870413 dv-cinder-784815-12-iscsi devstack@keystone.service[80275]: [pid: 80275|app: 0|req: 1455/2897] 10.222.0.23 () {58 vars in 1232 bytes} [Tue May 3 23:05:31 2022] DELETE /identity/v3/projects/bcb5428d0f88461c85bb4240a19b6f45 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 03 23:08:48.304500 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Authenticating user token {{(pid=80276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 03 23:08:48.305891 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:08:48.372546 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31748ff8-cef6-4959-a826-9cd0486c5e62 admin admin] Validating token access rules against request {{(pid=80276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 03 23:08:48.428382 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '166a670867884c689f3dd5c93b58b97f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fb1ca1c708d4ac6a6e61018246d47d0', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 03 23:08:48.429023 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] REQUEST_METHOD: `GET` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 03 23:08:48.429303 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 03 23:08:48.429579 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 03 23:08:48.431299 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.fernet_utils [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 03 23:08:48.442715 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 03 23:08:48.444313 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a72382-9088-41d3-8995-dc43390a37a4 service placement] RBAC: Authorization granted {{(pid=80276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 03 23:08:48.453909 dv-cinder-784815-12-iscsi devstack@keystone.service[80276]: [pid: 80276|app: 0|req: 1443/2898] 10.222.0.23 () {60 vars in 1365 bytes} [Tue May 3 23:08:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)